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CHaPTEH  I 

THE  PROBLEivi,  ITS  JUSTIi^ICATIOiJ  OBJECTIVES 

The  Problem  Stated 
This  study  proposes  to  det amine  to  what  relative  degree 
the  American  Council  on  Education  Psychological  Examination, 
1946  Edition,  predicts  success  in  the  first  semester  of  the 
freshman  year  at  the  University  of  n^assachusetts  at  i'ort  Devens 
when  it  is  used  as  a  speed  test  and  as  a  power  test. 

Justification  for  This  Study 
General  consideration.    With  many  students  seeking  admis- 
sion to  colleges  v^here  limited  facilities  are  available  it  be- 
comes necessary  to  have  an  adeqmte  basis  for  their  selection. 
What  constitutes  an  adequate  basis,  hov/ever,  has  consistently 
been  difficult  to  establish.     Crawford"^  says,  "If  an  institu- 
tion is  to  admit  only  a  certain  number  of  candidates,  it  must 
be  able  to  first  of  all  justify  its  selection  upon  intellectual 
standards."    Koos  and  Kefauver^  suggest  that  "general  intelli- 
gence seemed  to  represent  a  practicable  measure  of  capacity  for 
success  in  college  v/ork."    In  a  study  of  students  with  high 
aptitude  and  low  grades  and  with  low  aptitude  and  high  grades 

TT    A.  B.  Crawford.  "Forecasting  i'reshmen  Achievement", 
School  and  Society,  (January  £6,  1930),  21,  125-132 

2.    L.        Koos,  and  G.  i^'.  Kefauver.  Guidance  in  Secondary 
Schools .  iviacmillan  Company,  i^ev/  York,  1932,  p  29  2 
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Gerberich    concluded  that  the  amount  of  time  spent  in  study  and 
study  habits  were  the  most  significant  factors.     Stagner^  con- 
cluded that  personality  had  an  indirect  influence  on  achieve- 
ment in  that  it  affects  the  degree  to  v/hich  use  is  made  of  the 
individual's  potentialities.    Hovifever,  with  reference  to  the 
use  of  personality  measures  as  an  entrance  qualification  he 
notes,  "Personality  measures  can  never  be  used . . .becaus e  the 
student  scoring  high  on  undesirable  traits  are  also  high  on 
aptitudes  and  represent  the  very  stratum  we  should  be  develop- 
ing rather  than  discouraging." 

It  would  seem  then  that  some  measure  ol:  scholastic  apti- 
tude is  probably  the  best  single  criterion.    But  as  Quaid*^ 
points  out. 

Because  of  curricula  varying  both  in  content  and 
difficulty  in  different  institutions  of  higher  educa- 
tion, varying  medians  of  ability  in  freshman  classes 
in  different  colleges. • .varying  methods  of  teaching 
and  standards  of  achievement ,..  .no  uniforni  criteria 
can  be  prescribed  for  the  evaluation  of  ability  of 
freshmen  to  succeed  in  all  colleges  or  universities. 

I^evertheless  it  may  be  possible  within  a  narrower  area  to 

establish  a  fairly  adequate  basis  for  this  discriminative 

process. 


IT  J.  S.  Gerberich.  "i'actors  Related  to  the  College  Achieve- 
ment of  High- Aptitude  Students  Wh.o  Fa.il  of  Expectation  and  Low^ 
Aptitude  Students  Who  Exceed  Expectation,  J ournal  of  Ed uc a t i ona: . 
Psychology.  (April,  1941),  32,  £53-65 

2.  R.  Stagner.  "Relation  of  Personality  to  Academic  Aptitude 
and  Achievement",  Journal  of  Educational  Research",  (i^y,  1933), 
26,  648-660. 

i 

3.  T.  D.  D.  D.  Quaid.  "Study  of  Prediction  of  College  karksfl'. 
Journal  of  Experimental  Education,  (karch,  1938),  6,  360-375  I 
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Local  considerations*    It  is  well  knov/n  that  the  correla- 
tion between  scores  on  scholastic  aptitude  tests  and  school 
grades  varies  widely.    Although  the  concept  of  general  intelli- 
gence (scholastic  aptitude)   includes  a  speed  factor,  it  is  also 
true  that  there  are  persons  v/ho  manifest  high  scholastic  achievs- 
ment  and  yet  make  low  scores  on  an  intelligence  test  v/here 
speed  is  a  factor. 

The  problem  of  this  thesis  vi/as  suggested  to  the  author 
when  it  was  discovered  that  there  was  a  very  low  correlation 
between  student  grades  and  scores  on  the  ^i.  C.  ii.  Psychological 
Examination  and  that  a  considerable  niimber  of  students  vjho 
scored  very  lov/  on  this  examination  were  very  superior  in 
achievement  at  the  University  of  luassachusetts  at  ii^ort  Levens. 
It  was  felt  that  one  factor  causing  the  lov/  correlation  at  this 
institution  might  be  the  penalization  of  these  lovz-scor e-high- 
achievement  individuals  by  the  speed  factor  present  in  the 
A.  G.  S.  Psychological  Examination.    This  hypothesis  seems  to 
be  supported  considerably  by  the  fact  that  certain  of  these 
students  when  tested  on  the  Ohio  State  Psychological  iilxamina- 
tion,  a  power  or  work-limit  test  of  scholastic  aptitude,  scored 
in  the  90th.  percentile  or  better.     It  v/as  also  felt  that  for 
better  individual  guidance  of  students  it  was  highly  necessary 
to  be  able  to  ascertain  the  scholastic  aptitude  of  such  deviant 
individuals  more  accurately. 


Review  of  Related  Research 

Many  studies  indicate  the  degree  of  relationship  betv/een 
scores  on  entrance  instruments  and  college  grades  secured  by 
the  students.     Since  this  study  uiaices  use  of  the  American  Coun- 
cil on  Education  Psychological  Examination  relevant  findings 
will  be  discussed. 

Most  of  the  studies  concerned  with  the  predictive  quality 
of  certain  measures  have  one  basic  assumption.    The  grades  or 
the  course  marks  the  student  receives  are  the  criteria  against 
which  this  relationship  is  observed.    Several  studies  shov/  the 
unreliability  of  these  criteria,  but  marks  are  about  the  only 
available  means  of  noting  from  the  record  student  achievement 
in  a  course. 

Rogers-^  averaged  the  reliability  of  college  grades  for 
eight  semesters  and  found  a  correlation  of  .66,  v/ith  the  corre- 
lation decreasing  by  a  constant  amount  as  the  interval  between 
the  semesters  increased. 

j?reeman^  found  a  relationship  betv/een  the  a.  G.  E.  and 
college  grades  for  the  first  semester  of   .44  and  for  the  second 
semester  of  .46.    After  the  first  two  years  he  noted  a  negli- 
gible   positive  correlation  "due  to  the  fact  that  selective 
elimination  has  been  operating  thus  resulting  in  a  more 

rr  H.  W.  Rogers.  "Reliability  of  College  Grades",  School 
and  Society,  (May  29,  1927),  45,  758-760 

2.  F,  S.  Preeroan.  "Predicting  Academic  Survival",  Journal 
of  Educational  Research,  (February.  1921),  23,  113-122 


homogeneous  group  seen  in  reduced  coefficient  of  relationships.' 

kany  differences  may  be  seen  among  the  various  findings. 
Greene-'-  states  in  keasurement  of  Hrunan  Behavior  that  "predic- 
tion correlations  of  .70  are  usiially  as  high  as  may  be  expected." 
In  discussing  the  1929  A.  G.  E.,  Thurstone*^  v/rites. 

When  the  grading  standards  of  a  college  are  main- 
tained with  fair  uniformity  among  the  different  courses, 
the  correlations  between  tests  and  grades  should  be  be- 
tween .40  and  .60... The  v/ide  range  of  ability  v/ithin 
the  freshman  class,  v/here  failure  students  are  not  elim- 
inated by  entrance  examinations,  results  in  lower  cor- 
relation. 

Melvin  Rigg^  reported  correlations  betv/een  scores  on  the  A.  C* 

B.  and  grades  for  seven  successive  graduating  classes  in  a 

small  college  for  men.    The  correlations  v/ere  higher  betvi/een 

intelligence  scores  and  the  first  semester's  grades  than  those 

between  intelligence  and  four-year  grades. 

Correlations  between  scores  on  the        G.  E.  and  weighted 

grade  point  averages  of  three  entering  freshman  groups  at  the 

University  of  Arkansas  were  .463,  .575,  and  .546  as  found  by 
4 

Gerberich  .    He  also  states,   "The  coefficients  indicate  that 

experience  v;ith  the  predictive  power  of  these  Vi/idely  used 

IT  Edward  B.  Greene,  keasurement  of  Human  Behavior,  Odyssey 
Press,  Eew  York,  1941,  p  £56 

2.  L.  L.  Thurstone  and  G.  L.  Thurstone.  "The  1929  isycholo- 
gical  Examination",  Educational  Record.  (April,  1930) ,  11,  101- 
128 

3.  i-ielvin  G.  Rigg.  "The  Relation  of  College  Achievement  Tests 
to  Grades  and  to  Intelligence",  Journal  of  Educational  Isychol- 
ogy.  (May,  1939),  30,  397-400 

4.  J.  R.  Gerberich.  loc .cit . 


entrance  tests  at  the  University  of  Arkansas  has  been  typical 
of  experience  elsewhere," 

Quaid-^  used  five  variables,  among  which  v;as  the  ^,  C.  iil,, 
in  determining  the  relative  value  of  several  measures  for  pre- 
dicting college  freshman  grades.     The  Ohio  State  Isychological 
Examination  ranked  first  as  a  predictive  instrument  with  a  cor- 
relation of  ,473  and  the  A»  C.  E«  ranked  third  with  a  correla- 
tion of  ,367.    Schmitz's^  study  of  a  similar  nature  ranked  the 
A.  C.  E.  second  as  an  instrument  for  predicting  success  in 
college,  having  an  "r"  of  .583  v^ith  college  grades.     His  study 
also  revealed  that  the  ^,  C.  E.  was  only  slightly  better  than 
the  Army  Alpha  in  predicting  college  success. 

In  correlating  the  A.  C.  E.  with  total  grade  point  averages 
in  each  of  six  subject  matter  areas  during  a  three-year  period 
Lanigan^  found  only  two  significant  correlations,  an  "r"  of 
.601  for  Social  Studies  and  an  "r"  of  .442  for  Science.  vVaits^ 
reported , 

There  is  not  sufficient  difference  in  the  weights 
of  a  given  subtest  for  the  different  groups.  Agricul- 
tural, Engineering  and  General  to  warrant  differential 


17  T.  P.  D.  D.  Quaid.  loc.  cit. 

£.  Sylvester  B.  Schmitz.  "Predicting  Success  in  College," 
Journal  of  Educational  Isychology.  (1937),  28,  466-473 

3#  k.  A.  Lanigan.  The  Effectiveness  of  the  Otis,  the  ^,  C.  E. 

and  the  iviinnesota  Speed  of  Heading  Tests  for  Predicting  Success 
in  College,  Unpublished  thesis,  Boston  University,  1947,  p  41 

4.  J.  Virgil  «Vaits.   "The  Differential  Predictive  Value  of 
the  Psychological  Examination  of  the  American  Council  on  Educa- 
tion", Journal  of  Experimental  Education.  (March,  1933) ,  1, 
264-271 
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prediction  of  scholastic  success  in  college  on  the 
basis  of  the  Psychological  Examination  of  the  Ameri- 
can Council  on  Education. 

A  summary  of  correlations  of  general  intelligence  measures 
with  grades  to  predict  success  in  college  was  indicated  by 
ilacphail^.    He  states,   "The  central  tendency  of  these  correla- 
tions is  from  ,40  to  .45.    Only  a  very  fev;  fall  below  .30  and 
a  number  are  reported  as  high  as  .60  or  more.    Over  two- thirds 
of  the  correlations  fall  between  .30  and  •50."    Ke  points  out 
"The  lower  correlation  may  be  caused  by  the  failure  of  those 
of  highest  intelligence  to  achieve  on  a  commensurate  level  or 
because  those  with  lowest  intelligence,  through  good  study 
habits,  or  persistence,  achieve  more  highly  than  the  test  scores 
may  indicate." 

In  discussing  the  evolution  of  the  Ohio  State  University 

Psychological  Examination,  Toops^  says. 

It  was  suggested  that  the  examination  ought  to  be- 
come a  work-limit  rather  than  a  time  limit  test.  This 
would  enable  even  more  difficult  items  than  formerly 
to  be  used  and  yet  the  examination  to  possess  the  ad- 
vantage of  being  attempted  by  all.    The  style  in  test- 
making  hitherto  had  been  largely  to  the  effect  that 
items  should  be  arranged  in  order  of  increasing  diffi- 
culty.    Hhen  items  are  so  arranged  on  a  time-limit 
obviously  the  poorer  students  are  not  able  to  attempt 
any  of  the  really  difficult  items,  which,  when  attempted, 
have  been  found  in  general  to  yield  greater  differentia- 
tion among  poor  and  good  scholars  than  the  easier  items.... 
The  need  for  such  also  grew  out  of  considering  why  so 


'  .  1.  And  rev/  H.  kacPhail.  The  Intelligence  of  College  Students.  | 
Warwick  and  York,  Baltimore,  1924,  p  £8 

2.  Herbert  A.  Toops.  "The  Evolution  of  the  Ohio  State  Univer- 
sity Psychological  Test",  Ohio  College  Association  Bulletins 
97-130.   (1937),  113,  2283-£3a8 


many  'highly  intelligent'  students  do  so  poorly  in 
college.    Possibly  such  can  motivate  themselves  to 
high  effort  for  a  short  time.  ..long  enough  to  take 
a  test,  for  e2cample--but  are  incapable  of  the  long 
and  sustained  effort  necessary  for  college  success, 
Pinally  as  a  third  consideration,  the  work-limit 
type  of  administration — or  rather  an  approximation 
thereto — had  been  found  to  be  slightly  more  valid 
than  time- limit,  in  several  experiments  in  v/hich 
examinees  had  taken  a  given  form  of  our  test,... 


Objectives  of  This  Study 
In  the  studies  cited,  typical  of  those  found  in  the  liter- 
ature, the  correlations  betv/een  test  scores  and  college  grades 
were  made,  with  one  or  tv/o  exceptions  using  a  speed-  or  time- 
limit  instrument  for  measuring  intelligence,    lio  study  points 
out  the  effect  of  speed  on  individual  a.  G.       scores  or  the 
possibility  that  this  test  could  be  used  as  a  work-limit  or 
power  test. 

This  study  attempts  to  discover  the  relative  degree  of 
relationship  that  exists  between  grades  and  scores  on  the  Amerii 
can  Council  on  Education  Psychological  Examination  1946  Edition 
when  it  is  used  both  as  a  speed  test  and  as  a  power  test. 


Mature  of  the  Sample  and  the  Institution 
It  should  be  noted  that  this  study  differs  from  those  re- 
ported in  the  literature  reviewed  in  at  least  tv/o  aspects. 
These  differences  may  be  especially  significant  in  interpreting 
the  data  obtained. 

The  group  under  consideration  diiri  ng  this  study  are  all 
male  veterans  v/ho  entered  college  in  September,  1947.  There- 
fore, although  no  objective  evidence  is  available,  it  is 


possible  that  factors  such  as  difficulty  of  readjusting  to  c 
civilian  life,  greater  maturity  and  motivation,  and  others  may 
have  entered  in  and  significantly  altered  the  situation. 

The  University  of  i..assachusetts  at  i'ort  levens  differs 
from  the  institutions  v/here  the  studies  above  v/ere  made.  It 
was  established  in  September,  1946,  as  a  temporary  institution 
offering  two  years  of  liberal  arts  education  to  veteran  stu- 
dents.   At  the  end  of  these  first  two  years  the  students  are 
expected  to  transfer  to  other  colleges  to  finish  their  courses 
for  an  undergraduate  degree.    The  students  have  been  made  con- 
stantly av^are  of  the  importance  of  high  scholastic  standing 
in  order  to  facilitate  their  transfer  to  institutions  ^ich  are  ^ 
highly  restrictive  because  of  some  reluctance  to  take  transfer 
students  and  because  of  overtaxed  facilities.    The  faculty 
of  the  University  is  quite  heterogeneous  compared  to  that  of 
most  institutions,    iuost  of  the  faculty  members  came  from  other 
long- established  schools  throughout  the  united  States.  About 
one-half  of  them  had  had  no  college  teaching  experience  prior 
to  coming  here,    a  great  proportion  of  these  came  from  private 
preparatory  schools  while  the  remainder  came  from  public  sec-  , 
ondary  schools.    About  one-quarter  of  the  faculty  had  had  only  ' 
one-year's  teaching  experience  prior  to  September,  1947.  These 
facts  about  the  institution  are  presented  to  emphasize  the  pos- 
sibility of  their  effect  upon  the  motivation  of  the  students 
and  the  grading  standards  and  consequently  the  need  to  consider 
their  effect  upon  the  data  in  this  study. 


CHAPTER  II 


i 


CHAPTER  II 
METHOD  OF  STUDY 


Sources  of  Information 
The  Office  of  Hecords  and  Guidance  of  the  University  of 
Massachusetts  at  Fort  Devens  made  available  the  records  of 
grades  of  the  students  used  in  this  study. 

I         The  students  include  only  those  who  entered  this  insti- 
tution for  the  freshman  year  begun  in  September,  1947.  This 
particular  class  was  selected  rather  than  some  previous  one 
because  it  enabled  the  author  to  use  the  test  procedures  out- 
lined below. 

The  records  of  test  scores,  both  for  speed  and  pov/er,  v;ere 
obtained  directly  from  the  answer  sheets  of  the  1946  iidition  of 
khe  American  Council  on  Education  Psychological  anamination  for 
pollege  Freshmen  as  indicated  in  the  discussion  of  procedure. 

The  measures  of  central  tendency  and  variability,  and  cor- 
relations between  grades  and  ii.  C.  E.  scores  for  classes  who 
Entered  this  college  prior  to  September,  1943,  were  obtained 
rom  the  Office  of  Records  and  Guidance. 

Description  of  the  Instrument  Used 
The  American  Council  on  Education  Psychological  Examination" 

1.  Published  by  the  American  Council  on  Education,  744  Jack- 
son Place,  /Washington  6,  D.  C. 
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is  a  measure  of  scholastic  aptitude.     It  is  widely  used  with 
college  freshiflen.     The  test  is  divided  into  six  subtests  tl^iree 
of  which,  considered  together,  yield  a  Q  score  or  a  score  for 
quantitative  ability.     The  other  three  yield  an  L  score  or  a 
score  for  linguistic  ability.    The  y  and  L  scores  in  combina- 
tion produce  a  total  score.     This  arrangement  of  subtests  and 
scores  is  based  upon  observations  and  research  which  indicate 
that  two  kinds  of  scholastic  aptitude  are  related  to  success 
in  a  variety  of  school  subjects.    The  number  of  items  from  which 
the  linguistic  score  is  obtained  is  roughly  twice  as  many  as 
those  from  wrhich  the  quantitative  score  is  obtained.    Uo  evi-  ■ 
dence  is  offered  in  the  test  manual  as  to  the  validity  or  the 
reliability  of  any  of  the  scores. 

The  total  time  for  administration  is  fifty-eight  minutes. 
This  is  divided  into  twenty  minutes  for  practice  tests  and 
thirty- eight  minutes  for  the  testing.     There  is  only  one  form 
of  the  1946  Edition.    A  copy  of  the  test  will  be  found  in  the 
Appendix. 

Procurement  of  Data 
The  1946  Edition  of  the  A.  G.  E.  Psychological  Examination 
was  administered  to  one  hundred  and  eighty  entering  male  fresh- 
men.    The  administrative  procedures  prescribed  in  the  manual 
of  directions  accompanying  the  test  v^ere  f  ollO¥<red  with  one  ex- 
ception; that  is,  red  rather  than  black  pencils  were  used  by 
the  testees.    At  the  end  of  the  test,  using  the  above  procedure, 
certain  modified  directions  for  administration  designed  to 


remove  the  speed  factor  and  yield  a  power  or  work-limit  score 

for  the  test,  were  read  to  the  testees  and  the  test  proceeded 

accordingly.    The  modified  directions  read  as  follov/s: 

STOP.     Everybody  stop.     Even  if  you  have  not  finished 
the  Verbal  Analogies  test,  you  must  stop. 

Keep  your  seats  and  do  not  communicate  with  your 
neighbor. 

You  probably  feel  that  you  have  had  to  work  too  fast 
as  the  examination  proceeded.    iJov^f  vi^e  are  going  to 
allov;  you  to  go  over  v/hat  you  have  done  and  continue 
the  examination  at  your  own  speed  in  an  attempt  to 
improve  your  score.    As  a  result  we  v/ill  be  able  to 
evaluate  better  the  score  you  make  on  the  v/hole  test. 

Give  your  red  pencils  to  the  proctors.    You  will  nov.^ 
use  the  black  pencil  you  brought  to  the  examination 
with  you. 

Turn  to  the  first  test  entitled  Arithmetic  on  iage  4 
of  the  exam  booklet. 

Do  not  start  until  the  starting  signal  is  given,  r^s 
soon  as  the  starting  signal  is  given  you  may  proceed 
to  ansvi^er  any  incomplete  questions  or  to  correct  any 
questions  on  any  part  of  the  examination. 

Go  right  through  the  booklet;  do  not  ?»&it  for  any  stop 
or  go  signals  for  each  part.    Continue  right  through 
to  the  end  of  the  booklet. 

Be  sure,  hov^^ever,  that  you  make  no  erasures  or  make  any 
changes  whatsoever  of  the  RED  marks  that  you  have 
9-lready  made  on  the  ansvi/er  sheet.    You  are  to  correct 
ansv/ers  by  blackening  the  proper  space  on  the  answer 
sheet  without  erasing  the  red  mark  you  feel  is  wrong. 
You  may  erese  any  BLACK  pencil  mark  you  wish.    Be  sure 
that  you  mark  the  proper  space  on  the  answer  sheet. 
To  do  this  remember  to  find  the  corresponding  titles 
on  the  various  subtests  and  the  answer  sheet. 

There  will  be  no  time  limit.    You  may  continue  to  an- 
swer questions  as  long  as  you  v^ish.    'i/Vhen  you  are  fin- 
ished raise  your  hand  and  a  proctor  will  come  to  your 
seat  to  collect  your  test  booklet  and  answer  sheet. 


ANY  QUESTIOi^S?  (lAUSE)   irtfAIT  i'OR  TEE  STARTIijG  SIGML.  GO. 
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The  Q,  L  and  total  raw  speed  scores  were  computed  by 
ascertaining  the  total  number  of  correct  responses  in  red  p«i- 
cll  for  the  respective  parts  of  the  test. 

The  Q,  L  and  total  raw  pov/er  scores  vi/ere  computed  by 
ascertaining  the  total  number  of  correct  responses  in  both  red 
and  black  pencil  for  the  respective  parts  of  the  test. 

The  gains  made  on  each  part  of  the  test  under  the  modified 
testing  procedure  were  computed  by  counting  the  total  number  of 
correct  responses  in  black  pencil. 

A  record  of  the  amount  of  additional  tinie  each  student 
used  under  the  modified  testing  procedure  already  indicated  was 
ij  made  on  his  answer  sheet  when  it  was  collected, 
i  The  semester  grade  averages  were  computed  by  averaging  the 

grades  made  by  each  individual  in  the  five  subjects  he  was  re- 
quired to  take  during  the  period  September  -  January,  1947-48. 
It  is  important  to  note  here  that  the  subjects  required  are  of 
a  typical  survey  type  found  in  the  first  semester  of  liberal 
arts  colleges. 

Treatment  of  Data 
Measures  of  central  tendency  and  measures  of  variability 
were  computed  for  each  of  the  scores  listed  below: 

1.  Q,  L  and  total  raw  speed  scores 

2.  Q,  L  and  total  raw  power  scores 

3.  Q,  L  and  total  raw  gain  scores 

4.  Semester  grades 
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The  Pearson  product-moment  technique  was  used  to  find  the 

correlation  hetw^een  the  follov;ing  measures; 

1.    Q,  L  and  total  raw  speed  scores  respectively  and 
semester  grades 

£.     Q,  L  and  total  raw  power  scores  respectively 
and  semester  grades 

3,    Q,  L  and  total  raw  speed  scores  respectively 

and  Q,  L  and  total  raw  power  scores  respectively. 

As  an  aid  to  interpretation  these  correlations  will  be 
compared  with  those  reported  in  other  studies. 

To  determine  whether  or  not  the  obtained  correlations 
were  significant  the  general  procedure  suggested  belov/  was 
used : ^ 

For  any  given  size  sample,  one  can  compute  the 
minimum  value  of   *r'  that  will  be  significant  at  any 
given  level,  by  substituting  in 

/the  formula  t  =      r      .  y^^JTg — ^ 
v'l-rS 

the  value  of  li  and  the  value  of  't*  needed  at  that 
level,  and  solving  for  'r'  .     This  has  been  done  by 
the  writer  (at  the  5  per  cent  and  1  per  cent  levels) 
for  a  selected  number  of  values  of  IJ,  and  the  results 
presented  in  Table  13.... Given  this  table,  the  stu- 
dent will  have  little  occasion  to  use  /the  formula 
above/.     If  the  size  of  the  sample  in  question  lies 
betv/een  two  of  the  li's  given  in  Table  12,  it  will  be 
sufficiently  accurate  for  most  practical  purposes  to 
use  the  value  of  'r'  for  the  nearest  Li  given,  or  to 
interpolate  linearly  betv/een  the  two  nearest  values 
given. 

Specifically  the  suggestion  concerning  the  use  of  the  tables 


TT  E.  F»  lindquist.  Statistical  Analysis  in  .Educational 
Research,  Houghton  kifflin  Company,  Boston,  1940,  p  211 


rather  than  the  formula  and  the  suggestion  of  interpolating 
linearly  between  the  two  nearest  ii  values  were  used.    Also  the 
1  per  cent  level  of  confidence  was  used. 

In  judging  whether  or  not  the  differences  between  the 
several  correlations  were  significant  the  procedures  were  de- 
cided in  the  light  of  the  follov/ing  information  from  Lindquist: 

If  both  /correlations/  are  obtained  from  the 
same  sample,  and  if  there  is  any  correlation  between 
either  of  the  variables  involved  in  the  first  corre- 
lation and  either  involved  in  the  second,  the  test 
just  described  /for  independent  random  samples/  would 
be  invalid. .. .Suppose,  for  example,  that  in  a  study 
of  the  relative  validity  of  two  tests,  A  and  B,  in 
relation- to  a  criterion  C,  'r^^c'  and  'rjjc*  v</ere  com- 
puted for  the  same  sample.     The  difference  in  these 
* validity  coefficients'  could  not  be  evaluated  in  the 
manner  described  in  the  preceding  paragraphs;  or,  if 
this  test  were  applied,  the  estimated  standard  error 
of  the  difference  would  be  considerably  larger  than 
the  true  standard  error.... 

Until  very  recently,  no  satisfactory  test  of 
the  significance  of  a  difference  between  correlated 
coefficients  v/as  available. ..  .according  to  Cochran, 
the  difference  betv;een  'rig'  and  'ri3'  for  a  random 
sample  of  'n'   cases  may  be  tested  by  ccanputing 

^    _      <  ^12-^15^      \/  n  -  5     \/  1  -I-  r^g  ^  

"  ^~        V  1  .  r-L^S-rig^-r^g^  +  ^r^s'^lS^SS 

't*  having  ln-3)  degrees  of  freedom.    In  this  expres- 
sion the  coefficients  'ri2*  '^13*         given  the 
same  sign  before  taking  the  difference,  the  test  being 
merely  one  of  their  absolute  magnitude  and  not  involv- 
ing signs. 

The  1  per  cent  level  of  significance  was  the  standard  used 
for  evaluating  each  obtained  '^t".    This  means  that  in  order  for 


,.  Ibid,  p  E17-218 


a  difference  "between  any  tv/o  correlations  to  be  judged  signifi- 
cant the  "t"  value  must  exceed  £.57682  as  indicated  in  the 
table  Of  n^H  values  cited  by  Mills. ^ 


Assumptions  Made 
Certain  assumptions  are,  of  course,  made  in  this  study, 
^h©  major  ones  are  listed  here: 

1.  That  the  1946  i^aition  of  the  A.  G.  E.  is  a  valid  and 
reliable  measure  of  scholastic  aptitude.    The  manual 
for  this  edition  reports  no  validity  or  reliability 
data.  However,  in  commenting  on  the  1931  Psychological 
Examination,  the  Thurstones  stated:     "Irevious  studies 
of  reliability  and  validity  have  shown  the  reliability 
of  the  gross  scores  to  be  about  .95  and  the  correlation 
between  test  scores  and  scholarship  have  averaged 
around  .50  for  a  large  number  of  colleges." 

2.  That  grades  are,  in  part,  a  function  of  scholastic 
aptitude. 

3.  That  scores  on  speed  tests  of  intelligence,  though 
correlated  positively  with  scholastic  achievement, 
sometimes  penalize  slow„individuals  with  high  scho- 
lastic aptitude.    Toops    has  been  cited  previously 
in  reference  to  this. 

4.  That  the  population  used  in  this  study  is  representa- 
tive of  the  entire  school  population.    The  range  of 
A.  C.  E.  speed  scores  for  this  group  is  91,  with  a 
bottom  raw  total  score  of  72  and  a  top  raw  total  score 
of  163.    The  mean  and  standard  deviation  for  the  group 
are  119.87  and  17,16  respectively.    The  mean  and 
standard  deviation  for  the  total  University 


>•  Pred«riok  C»  Mills.  Statistical  Method s.(  Revised) .  Henry 
Holt  and  Company,  Hew  York,  1938,  p  603 

2.  L.  L.  Thurstone  and  T.  G.  Thurstone.  "The  1931  Psycho- 
logical Examination",  Educational  Record.  (April, 1932) ,  13, 
121-126 


3.  Toops,  op.  cit..  p2290 
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sity  population  are  respectively  116.70  and  19.602.    ^  test  of 
the  hypothesis  that  the  means  of  the  tv;o  groups  are  equal  re- 
vealed that  this  hypothesis  was  tenable  at  the  1  per  cent  level 
of  confidence. 

6.    That  the  administrative  techniques  employed  with  the 
A.  C.  S.  are  in  accordance  with  standard  procedure  to  insure 
optimal  motivation. 

6.     That  the  subjects  adopted  the  motivational  set  intendet 
by  the  examiner.    The  validity  of  assumptions  5  and  6  may  be 
inferred  from  the  fact  that  the  minimum  additional  time  used 
under  the  modified  administrative  procedure  by  members  of  the 
group  was  sixteen  minutes,  a  maximum  additional  time  of  fifty- 
nine  minutes  and  an  average  additional  time  of  thirty-five 
minutes. 

Summary 

This  study  is  concerned  with  the  relative  predictive  value 
of  the  American  Council  Psychological  Sxaminat  ion  when  it  is 
used  as  a  speed  test  and  as  a  power  test. 

In  order  to  obtain  Q,  L  and  total  speed  and  pov;er  scores 
from  the  A.  C.  E.  the  test  was  administered  according  to  the 
manual  of  directions  to  obtain  the  former  and  in  accordance  with 
a  modified  set  of  directions  to  obtain  the  latter.    A  record  of 
additional  time  to  complete  the  test  under  the  modified  proce- 
dure v/as  kept  for  each  individual. 

Means  and  standard  deviations  of  the  group  were  computed 
for  Q,  1  and  total  raw  speed  and  power  scares  respectively. 


The  same  computations  were  made  for  the  additional  number  of 
correct  responses  made  under  the  modified  administrative  direc- 
tions, i.  e.  the  gains. 

I  Student  achievement  was  judged  in  terms  of  the  average  of 

the  grade  scores  for  the  first  semester  of  the  freshman  year. 

Correlations  of  Q,  L  and  total  raw  speed  and  power  scores 
respectively  with  grades  and  of       L  and  total  raw  speed  scores 
respectively  with  Q,  L  and  total  raw  power  scores  were  computed. 

Each  correlation  was  tested  for  significance  at  the  1  per 
cent  level.    Likev/ise  the  differences  between  the  correlations 
of  Q,  L  and  total  speed  scores  respectively  v/ith  grades  and  of 
Q,  L  and  total  pov/er  scores  respectively  with  grades  were  evalu- 
ated for  significance  at  the  1  per  cent  level. 


CHAPTER  III 


CHAPTER  III 
PHESJiin'ATIOi^  OF  TKji  DATA 


Lescription  of  the  Group 
Distribution  of  speed  and  power  test  scores.     The  group 
used  in  this  study  included  180  male  freshmen  who  entered  the 
University  in  September,  1947 •    All  the  individuals  are  veter- 
ans of  World  NaT  II*    i'requency  distributions  of  (i,  L  and  total 
Frequency 
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Q  Speed  Scores 
figure  1 

Frequency  Distribution  of  180  Entering  iuale  Preshmen  at 
the  University  of  Massachusetts  at  i'ort  Devens  on  the 
Basis  of  Q  Speed  Scores  on  the  A.  C.  E. 

A.  G.  E.  speed,  power  and  gain  scores  illustrate  the  nature  of 

the  total  group  on  this  instrument. 


Figure  1  illustrates  the  distribution  of  the  population 
on  the  basis  of  Q  speed  scores.     It  is  to  be  noted  that  there 
is  a  bi-modal  tendency  and  a  slight  skew  to  the  right  of  the 
mean.    This  measure  seems  to  discriminate  better  among  the 
students  above,  rather  than  below,  the  mean. 

An  examination  of  the  distribution  of  L  speed  scores  in 
figure  2  reveals  a  bi-modal  tendency  again.  In  this  case  it 
frequency 
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L  Speed  Scores 
i'igure  2 

Frequency  Distribution  of  160  iintering  male  Freshmen 
at  the  University  of  kassachusetts  at  Fort  Levens  on 
the  Basis  of  L  Speed  Scores  on  the  ii.  0,  £, 

is  more  marked  than  for  the  Q  speed  scores.    However,  the  skew- 


ness  is  no  longer  present, 

Figure  5  shows  the  distribution  of  the  A.  C.  E,  total 
speed  scores  for  the  group.    Again  a  bi-modal  tendency  is  to 
be  observed  as  well  as  a  slight  skev/  to  the  right, 
5^requency 
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Total  Speed  Scores 
i'igure  3 

jj'requency  Distribution  of  180  Entering  Male  i'reshmen 
at  the  University  of  kassachusetts  at  jport  Levens  on 
the  Basis  of  A.  C.  E.  Total  Speed  Scores. 

The  distribution  of  Q  power  scores  illustrated  in  Figure 

4  reveals  some  considerable  changes  over  the  distribution  of 

the  previous  measures.    The  range  of  the  scores  is  the  same  as 

for  Q  speed.    However,  the  slight  right  skew  has  become  marked 
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Q  Power  Scores 
i'igure  4 

5^requency  Distribution  of  160  Entering  Wale  iTreshmen 
at  the  University  of  Massachusetts  at  Fort  Levens  on 
the  Basis  of  Q  Power  Scores  on  the  A.  C.  E. 

to  the  left.    The  group  is  more  homogeneous  in  nature.     The  bi- 
modal  tendency  is  lost.    A  possible  explanation  Ox  the  skewness 
and  homogeneity  may  be  that  the  poorer  students  had  the  advan- 
tage of  more  time  to  raise  their  scores  while  the  better  stu- 
dents had  the  disadvantage  of  being  restricted  by  the  upper 
limits  of  the  Q  part  of  the  test. 

As  would  be  expected  in  comparing  the  L  power  and  L  speed 
scores  there  is  a  shift  in  the  distribution  tov/ard  the  upper 
limits  on  the  L  part  of  the  A.  G.  E.  as  indicated  in  Figure  5. 
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L  Power  Scores 
jFigure  5 


J'requency  Distribution  of  180  ]2ntering  li^ale  jPreshmen 
at  the  University  of  kassachusetts  at  Fort  Devens  on 
the  Basis  of  L  Power  Scores  on  the  A.  C.  E. 

However,  the  bi-modal  tendency  is  lost.    Although  the  (d  and  1 
power  scores  are  not  strictly  comparable  measiires,  it  may  be 
possible  to  infer  that,  since  the  mean  of  the  latter  did  not 
shift  as  far  to  the  right  as  did  the  mean  of  the  former,  the  L 
part  of  the  A.  C.  E.  is  a  better  power  test  than  the  Q  part,  ' 
It  is  likely  too  that  the  students  used  in  this  study  are  less 
able  linguistically  than  they  are  quantitatively  since  the  maxi- 
mum possible  gains  in  L  and  Q  scores  which  the  best  student 
could  have  made  under  the  v/ork-limit  procedure  as  compared  to 
the  speed  procedure  were  13  and  11  points  respectively*  ^gain 
considering  the  L  power  scores  distribution  as  a  whole  in 
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relation  to  the  upper  limits  of  the  L  part  of  the  a.  G.  E,,  it 
would  seem  that  the  additional  time  used  was  not  sufficient  to 
produce  as  high  average  L  gains  as  for  Q  gains.    This  last 
observation  would  seem  to  substantiate  further  the  conclusion 
frequency 
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Total  Power  Scores 
Ji^igure  6 


j?requency  Distribution  of  180  Entering  kale  j'reshraen 
at  the  University  of  kassachusetts  at  i'ort  Levens  on 
the  Basis  of  A.  C,  E,  Total  Pov;er  Scores. 

that  these  students  are  better  in  the  qimntitative  area  than 

the  linguistic  area.     The  relative  distribution  of  Q  and  1 

gains  as  illustrated  in  Figures  7  and  8,  respectively,  offers 

a  clearer  picture  of  the  observations  just  made. 

Figure  6  points  out  a  consistent  shift  of  the  distribution 

of  the  total  scores  to  the  right  when  comparing  the  total  power 

with  the  total  speed  scores.    The  group  is  also  seen  to  be 
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  — 

slightly  more  homogeneous  when  plotted  according  to  the  former 
as  compared  to  the  latter  scores.     The  bi-modal  tendency  is 
lost. 

It  can  be  observed  that,  since  the  A,  C.  £.  seems  to  dis- 
criminate about  as  v/ell  with  total  pov;er  scores  as  compared  to 
total  speed  scores,  this  instrument  may  legitimately  be  used  as 
a  power  test.    As  has  already  been  noted,  it  would  seem  that 
the  linguistic  part  of  the  test  accounts  for  this  possibility 
better  than  the  quantitative  part,  at  least  for  the  group  used  j 
in  this  study.  jl 

Frequency  ll 
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Figure  7 

Frequency  Distribution  of  160  Entering  kale  Freshmen  at 
the  University  of  kassachusetts  at  Fort  Devens  on  the 
Basis  of  Q  Gain  Scores  on  the  A.  C.  E. 

In  Figure  7  it  may  be  seen  that  the  gains  made  by  the  group 


on  the  Q  part  of  the  A,  C,  E,  when  used  as  a  power  test  distri- 
buted v;ith  a  slight  skew  to  the  left  of  a  mean  of  19.70  over 
a  range  of  thirty  points.     This  resulted  in  a  piling  up  of 
scores  near  the  upper  limits  of  the  Q  part  of  the  test  as  v/as 
noted  previously  in  the  discussion  of  i'igure  4. 

When  the  distribution  of  L  gain  scores  in  i^igure  8  is 
Frequency 


L  Gain  Scores 
JTigure  8 

Frequency  Distribution  of  180  Entering  kale  i'resh- 
men  at  the  University  of  Massachusetts  at  Fort 
Devens  on  the  Basis  of  L  Gain  Scores  on  the  A.  G.  E. 

examined  it  is  to  be  noted  that  there  is  a  considerable  skew 

to  the  right  of  a  mean  of  1E.99.    A  possible  reason  for  this 

skewness  was  suggested  in  the  discussion  of  Figure  6.    It  was 
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judged  then  to  be  an  indication  of  the  students  used  in  this 
study  being  oetter  in  quantitative  ability  than  in  linguistic 
ability. 

i'igure  9  points  out   a  slightly  skev/ed  distribution  of 
total  gain  scores  to  the  right  of  the  mean.    Apparently  this  is 
a  result  of  the  marked  right  skew  foxmd  in  the  distribution  of 
L  gain  scores  not  having  been  completely  overccne  by  the  slight' 
left  skew  of  the  Q  gain  scores. 
Frequency 

35,  , 


Total  Gain  Scores 
Figure  9 

Frequency  Distribution  of  160  Wintering  i^iale  Freshmen 
at  the  University  of  kassach  usetts  at  Fort  Sevens  on 
the  Basis  of  Total  Gain  Scores  on  the  a.  G.  E. 

Distribution  of  semester  grade  averages.    Figure  10  shov/s 

that  the  semester  grade  averages  of  th  e  total  group  used  in 
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this  study  have  a  moderate  skew  to  the  left.     This  fact  is  par- 


ticularly interesting  in  this  study  since  it  has  been  noted 
before  that  the  Q  power  scores  distribute  in  much  the  same 
Frequency 
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Semester  Grade  Averages 
Figure  10 


Frequency  Distribution  of  180  laale  Freshmen  at  the 
University  of  Massachusetts  at  Fort  Devens  on  the 
Basis  of  Semester  Grade  Averages  for  Period  September- 
January  1947-48 

pattern,  and  as  will  be  noted  later  the  correlation  between  Q 
povifer  scores  and  grade  averages  is  the  highest  of  all  those 
computed. 

It  is  important  to  note  that  60  is  a  passing  grade  in  this 
University. 
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Means  and  standard  deviations  of  speed  and  power  test 
scores  and  gains*    The  averages  and  the  spread  of  the  A.  0.  E, 
scores  for  speed,  power  and  gains  are  indicated  in  Table  1  in 
summary  of  the  previous  discussion  of  these  measures. 
Table  1 

Means  and  Standard  Deviations  of  A.  C.  E.  Speed 
and  lower  Scores  and  Gains  of  180  Entering  ikiale 
Freshmen  at  the  University  of  kassachu setts  at 
jj'ort  Devens 


Score  on 

M 

C7 

c 

cr 

A.  C.  E. 

M 

c 

W  Speed 

46.  E4 

0.652 

8.73 

.461 

0  Power 

66.03 

0.696 

7.98 

.422 

W  Gains 

19.70 

0.471 

6.51 

.533 

L  Speed 

74.51 

0.9  24 

12.36 

.653 

L  lower 

87.25 

0.809 

10.82 

.672 

;l  Qain§ 

12.99 

0.496 

6.64 

.361 

T  Speed 

119.42 

1.275 

17.06 

.901 

T  Power 

162.00 

1.136 

15.18 

.602 

T  Gains 

52.60 

0.796 

10.64 

.562 

Comparison  of  the  group  Vifith  the  total  University  popula- 
tion.   An  attempt  was  made  to  establish  whether  or  not  the 
group  used  in  this  study  was  representative  of  the  total  popu- 
lation of  the  University.      A  comparison  of  the  means  and  stan- 
dard deviations  of  the  total  speed  scores  on  the  ii.  C.  E.  for 
each  of  the  two  groups  was  the  only  available  procedure.  The 
mean  and  standard  deviation  of  the  total  speed  scores  for  the 
group  in  this  study  are  respectively  119.42  and  17.066  while 
the  same  measures  for  the  total  University  population  are  re- 
spectively 118.70  and  19.602.    A  test  of  the  hypothesis  that 
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the  means  of  the  two  groups  are  equal  revealed  that  this 
hypothesis  was  tenable  at  the  1  per  cent  level  of  confidence. 
In  other  v;ords  the  group  used  in  this  study  is  representative 
of  the  total  population  of  the  University.     Thus  inferences 
drawn  from  the  data  in  this  study  for  the  University  populatiOD 
as  a  whole  may  be  accepted  v/ith  a  high  degree  of  confidence  at 
least  with  respect  to  total  speed  scores. 

Intercorrelations  between  Speed  and 
Power  Scores  and  Their  Significance 

According  to  the  procedures  outlined  in  Chapter  II  the 
correlations  between  speed  and  power  scores  anS  their  signifi- 
cance were  computed,    a  correlation  v/as  judged  significant  at 
the  1  per  cent  level  of  confidence  if  it  exceeded  .193. 
Table  2 

Summary  of  the  Correlations  and  Their  Significance 
betv;een  A.  C.  E.  Speed  and  lower  Scares  for  IbO 
h&le  freshmen  at  tne  University  of  Massachusetts 
at  Fort  Levens 


keasures 

Gorrelati  on 

Significance  at 
1  Per  Cent  Level 

Q  Speed  w/q  Power 

.708 

Yes 

L  S-peed  w/l  Pov;er 

.827 

Yes 

T  Speed  w/T  Power 

.785 

Yes 

An  examination  of  Table  2  shoves  that  the  correlation  be- 
tween Q  speed  and  Q  pov^er  scores  is  .708  and  that  it  is  signi- 
ficant according  to  the  criterion  used.     It  is  to  be  noted  that 
the  correlation  is  not  high  enougti  to  indicate  a  great  degree 
of  confidence  in  the  forecasting  efficiency  between  the  two 
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criteria.    In  other  words  there  is  reason  to  believe  that  the 
two  "tests"  are  measuring  different  things  to  a  considerable 
degree. 

The  correlation  of  L  speed  with  L  power  scores  is  .827. 
This  means  that  it  is  a  significant  correlation  at  the  1  per 
cent  level  of  confidence.    This  correlation  shows  a  marked 
relationship  between  the  two  measures  high  enough  to  indicate 
a  considerable  forecasting  efficiency  betw^een  the  two  criteria. 

The  total  speed  and  total  power  scores  correlate  .785  with 
each  other.    This  correlation  is  also  significant  since  it  is 
greater  than  .192.     It  shows,  too,  a  marked  relationship  be- 
tween the  two  measures  though  less  than  in  the  case  of  the  L 
speed  and  power  scores. 

Correlations  of  Speed  and  lower 
Scores  with  Grades  and  Their  Significance 

Correlations  of  speed  and  power  scores  for  each  part  of 
the  A.  C.  E.  with  semester  grade  averages  were  computed  using 
the  Pearson  product-moment  technique.    Each  correlation  was 
tested  for  significance  at  the  1  per  cent  level;  i.e.  a  corre- 
lation was  considered  significant  if  it  exceeded  an  "r"  of  .193 
The  significance  of  the  difference  between  the  speed  scores- 
grades  and  pov»fer  scores- grades  correlations  for  each  part  of 
the  A.  C.  E.  considered  separately  were  computed.    In  order  fcr 
I  a  difference  to  be  considered  significant  at  the  1  per  cait 

level  of  confidence  the  "t"  result  had  to  equal  or  exceed 
2.67&82. 


Table  3  summarizes  the  results  of  these  computations. 
An  examination  of  the  table  reveals  that  all  but  two  of 
the  correlations  are  significant,    iJeither  the  L  speed  v/ith 

Table  3 

Summary  of  Correlations,  the  Significance  and  Significance  of 
Differences  of  A.  C.  E,  Speed  and  Power  Scores  v;ith  i'irst  Sem- 
ester Grade  Averages  for  160  kale  i'reshmen  at  the  University 
of  Massachusetts  at  fort  Devens 
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Measures 

r 

Significance 
at  1  Per  Cent 
Level 

t 

Significance 
of  Difference 
at  1  Per  Gent 
Level 

Q  Speed  w/Grades 

.249 

Yes 

Uo 

Q  Power  w/Grades 

.316 

Yes 

1.21162 

L  Speed  w/Grades 

.172 

1^0 

iio 

L  Power  w/Grades 

.121 

Ho 

1.1720 

T  Speed  w/Grades 

.224 

Yes 

iio 

T  Power  w/Grades 

.261 

Yes 

0.7782 

grades  nor  the  L  power  with  grades  correlation  is  significant 
since  they  are  not  up  to  the  standard  of  an  "r"  of  .193.  This 
indicates  the  L  part  of  the  A.  C.  il.  when  used  as  a  speed  or  a 
power  test  has  no  practical  value  for  the  purpose  of  predicting 
grades  of  the  individuals  used  in  this  study. 

Considering  the  remaining  "r's"  it  is  to  be  noted  that, 
even  though  each  is  significant  according  to  the  standard  used, 
none  of  them  are  high  enough  to  have  any  prognostic  value  for 
practical  purposes. 

Table  3  also  reveals  that  none  of  the  three  "t"  results 
obtained  are  significant* 


Summary 


The  group  was  described  graphically  in  terms  of  Q,  1  and 
total  speed  and  pov^rer  scores  on  the  American  Council  Jixamina- 
tion  as  v/ell  as  in  terms  of  semester  grade  averages,    i^eans  and 
standard  deviations  vi^ere  computed  for  each  of  these  measures 
in  order  to  give  a  clearer  picture  of  the  group.  Comparisons 
between  these  various  scores  were  made.    The  following  major 
observations  were  made: 

1.  The  group  is  relatively  homogeneous  in  nature  on 
the  basis  of  every  measure. 

2.  Bi-modal  tendencies  were  found  in  several  of  the 
distributions  particularly  those  of  speed  scores. 
The  bi-modal  tendencies  vtfere  lost  in  the  distri- 
butions of  the  power  scores. 

3.  A  marked  skew  to  the  right  was  found  in  the  dis- 
tribution of  L  gain  scores  and  a  marked  skew  to  the 
left  in  the  case  of  Q  power  scores;  this  seems  to 
indicate  that  the  students  involved  in  this  study 
are  better  in  quantitative  ability  than  in  linguis- 
tic ability. 

4.  A  moderate  left  skew  which  was  found  for  semester 
grade  averages  was  particularly  interesting,  since 
the  Q  power  scores  distribute  s  iu-ilarly  and  the 
correlation  of  these  measures  is  the  highest  of  all 
those  found  between  test  scores  and  grade  averages. 
Slight  skews  both  to  the  left  and  right  were  found 
in  several  other  distributions. 

5.  In  comparing  the  distributions  of  L  speed  and  1 
power  scores  it  was  suggested  that  the  L  part  of 
the  A.  C.  E.  may  be  a  better  power  test  than  the 
Q  part  since  it  discriminated  better  among  the 
students  used  in  this  study. 

6.  The  fact  that  the    A.  G.  E.  seems  to  discriminate 
about  as  v;ell  v;ith  total  pov/er  scares  as  compared 
to  total  speed  scores  suggests  that  this  instrument 
may  be  legitimately  used  as  a  pov/er  test. 


7,  A  comparison  of  the  mean        I  and  total  speed  scores 
with  the  mean  Q,  L  and  total  pov<^er  scores  respectively 
revealed  differences  between  the  means  that,  by  in- 
spection, seemed  significant.    However,  to  corroborate 
this  point,  critical  ratios  are  reported  below. 

Table  4 

Significance  of  Differences  between  the  means 
of  Q,  L  and  Total  Speed  and  iovier  Scores  on 
the  A.  C,  E.  for  180  Male  ii^reshmen  at  the  Uni- 
versity of  i^assachusetts  at  i'ort  Devens 


Means  Compared 

P 

C.  li. 

Q  Speed  w/i.^  pov;er 
L  Speed  w/L  Power 
T  Speed  w/t  Power 

19,70 
1E.99 
3E.60 

.460 
,608 
.802 

41.00 
21.36 
40.65 

j  Since  a  critical  ratio  of  three  is  necessary  to  have 

1  a  significant  difference  at  the  0.26  level  of  con- 

fidence, it  may  be  seen  that  the  differences  between 
j  the  means  found  in  this  study  are  very  highly  sig- 

j  nificant. 

The  group  used  in  this  study  was  compared  with  the  total 

University  population  on  the  basis  of  means  and  standard  devia- 

I  tions  of  total  speed  scores,    i-lo  significant  difference  v;&s 

|! found  between  the  two  populations, 

!         Correlations  between  speed  and  pov/er  scores  and  their 
significance  were  computed.     The  correlation  coefficients  are: 
Q  speed  scores  with  k  pov/er  scores,  .718;  L  speed  scores  with 
L  power  scores,  .827;  and  total  speed  scores  with  total  pov/er 
scores,  ,785,    All  "r's"  were  found  significant  at  the  1  per 
cent  level  of  confidence,    T  he  first  correlation  was  judged  to 
be  low  enough  to  indicate  a  considerable  degree  of  measurement 
of  different  factors  by  the  respective  tests. 


Correlations  of  speed  and  pov/er  scores  v;ith  grades  and 
their  significance  were  computed,  Wovlt  of  the  six  correlation 
results  ranging  from  .£24  to  ,515  were  considered  significant 
at  the  1  per  cent  level.  Two  of  the  six  correlation  results, 
•121  and  .172,  were  not  considered  significant  at  this  level, 
ilone  of  the  six  correlation  coefficients  were  considered  high 
enough  for  prognostic  purposes. 

The  significance  of  the  difference  between  the  speed 
scores-grades  and  power  scores-grades  correlations  for  each 
part  of  the  A.  C.  E.  considered  separately  were  computed,  i^one 
of  the  differences  were  considered  significant. 
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CEAITEH  IV 


GEAPTSii  IV 
liviPLICATIOWS  Ai^lD  COWGIUSIOWS 


J^requency  Distribution  i!'indings 
Homogeneity  of  the  group.    Examination  of  the  frequency 
distributions  in  this  study  revealed  some  information  worth 
noting  and  discussing. 

The  group  in  this  study  was  found  to  be  relatively  homo-  j 
geneous  in  nature  on  the  basis  of  their  distribution  on  every  j 
measure  used.  To  be  sure,  this  is  probably  to  be  expected  | 
since  they  enter  the  University  as  the  result  of  a  rather  rigid | 
selective  process.  The  point  to  be  noted,  though,  is  that  the 
low  correlations  obtained  may  have  been  somewhat  predetermined 
by  this  factor  of  homogeneity.  It  is  questionable  hov/  much  , 
confidence  may  be  had  in  this  implication,  however,  in  view  of  i 
the  conflicting  opinions  pointed  out  previously  in  the  review  ' 
of  the  literature  related  to  this  study. 

Bi-modal  tendencies.  The  graphical  representations  of  the ; 
group  according  to  the  three  speed  scores  pointed  out  bi-modal  ! 
tendencies  which  were  largely  lost  in  the  distributions  of  the 
three  power  scores.  This  fact  along  v/ith  the  int ere orrelat ions  * 
between  the  speed  and  power  scores  seems  to  offer  good  evidence  1 
that  the  two  "tests"  are  measuring  different  things  to  some  j 
degree.  In  the  case  of  Q  and  total  speed  scores  the  pattern  of  ' 
the  curves  with  respect  to  bi-modality  is  very  nearly  the  same  j| 
and  less  marked  than  for  the  L  speed  scores.    An  examination 
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Of  the  Q  and  total  speed  scores-grades  oorrelations  showed  that 
they  are  more  nearly  like  each  other  than  either  is  like  the  L 
speed  scores-grades  correlation.    This  relationship  of  the  cor-; 
relations  can  probably  be  accounted  for  in  some  measure  by  the  | 
relationship  of  various  distribi;tions  of  the  speed  scores.  ! 

The  implications  of  skev/ness.     It  has  already  been  noted  I 
that  skewness  to  the  left  and  right  v/as  found  among  the  distri- 
butions of  the  various  measures.     Several  of  this  tyye  of  dis- 
tribution seeni  to  have  some  important  implications. 

A  marked  right  skew  v/as  foimd  in  the  distribution  of  L  gaii) 
scores.    A  similar  skew  in  the  opposite  direction  v/as  found  in 
the  case  of  Q  power  scores.    The  average  gains  in  Q  and  L 
scores  under  the  v/ork-limit  test  procedure  were  19.70  and  12.99  j 
points,  respectively.    The  maximum  additional  points  which  the 
best  students  could  have  made  on  these  tv/o  parts  of  the  A.  C.  £« 
differed  by  only  two  score  points.    At  first  it  appeared  that 
the  explanation  for  these  observations  of  skewness  was  that  the 
best  students  had  been  restricted  by  the  upper  li.uits  of  the  Q 
part  but  not  the  L  part  of  the  test.    Eov/ever,  in  view  of  the 
difference  of  average  gains,  the  closeness  of  the  maximum  gains 
possible,  and  the  further  observation  that  the  Q  and  L  speed 
scores  distributed  very  similarly  and  that  the  L  pov/er  scores 
were  nearly  normal  while  the  Q.  pov/er  scares  shov/ed  a  marked 
left  skew,  it  was  judged  that  a  more  likely  explanation  is  that 
the  students  involved  in  this  study  are  more  able  quantitatively 
than  linguistically. 


« 


f 


A  moclerate  left  skew  v^as  found  in  the  distribution  of 
semester  grade  averages.    The  shape  of  the  curve  of  distribu- 
tion of  Q  power  scores  is  more  nearly  like  that  of  semester 
grade  averages  than  any  of  the  others.    This  relationship  of 
Q  power  scores  and  grades  may  account  for  the  fact  that  the 
correlation  between  these  measures  v/as  the  highest  one  obtained 
It  is  important,  though,  that  this  conclusion  be  considered  in 
light  of  the  facts  that  none  of  the  differences  in  "r^"  were 
found  significant,  that  the  group  was  -^s-e- homogeneous  in  nature 
on  all  the  measures,  and  that  not  all  the  distributions  were 
drawn  to  the  same  scale. 

Use  of  the  A.  G.  £.  as  a  power  test.    Several  of  the  fre- 
quency distributions  seem  to  have  an  important  bearing  on  the 
question  as  to  whether  or  not  the  A.  C.  E»  can  be  used  legiti- 
mately as  a  power  test  of  intelligeace. 

Comparison  of  the  L  speed  and  L  pov/er  scores  distributions 
revealed  that  the  spread  of  the  group  was  very  nearly  alike. 
A  consistent  shift  all  along  the  scale  toward  the  upper  limits 
of  the  I  part  of  the  test  was  made  under  the  work-limit  proce- 
dure as  compared  to  the  time-limit  procedure  of  administration. 
As  noted  previously  the  Q,  scores  did  not  show  this  consistent 
shift  to  the  right  all  along  the  scale  when  comparing  ^  speed 
and  power  scores  distributions.    Instead  there  was  a  marked 
piling  up  of  the  Q  power  scores  at  the  upper  end.    The  contrast 
between  the  Q  and  I  scores  distributions  seems  to  indicate  that 
the  L  part  of  the  A.  C.  B.  is  a  better  power  test  than  the  Q 
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part  since  it  discriminates  better  among  the  students  used  in 
this  study.    This  conclusion  must  be  considered  in  the  light  of 
the  fact  that  the  Q  and  L  sccres  distributions  are  not  strictly 
comparable  measures  and  that  the  L  score-grades  correlations 
are  considerably  lov/er  than  the  Q  score- grades  correlations. 
It  may  be  that  this  conclusion  is  correct  and  that  the  failure 
to  obtain  the  higher  correlations  betv;een  L  scores  and  grades 
lies  in  the  failure  of  the  grading  system  to  discr iu^inate 
among  the  students  as  well  as  the  1  section  of  the  A.  C.  E* 
It  was  pointed  out  previously  that  the  total  speed  and 
power  scores  distribute  very  much  alike.    The  group  is  slightly 
more  homogeneous  in  nature  according  to  the  spread  of  the  total 
power  scores.    An  insignificant  difference  was  found  betv/een 
the  total  speed  scores- grades  correlation  and  the  total  power 
scores-grades  correlation.    These  observations  seem  to  indicate 
that  the  A.  G.  E.  can  be  used  about  equally  as  well  as  a  speed 
or  power  test,  at  least  for  the  group  used  in  this  study.  As 
has  already  been  noted,  the  linguistic  part  of  the  test  seems 
to  account  for  this  possibility  better  than  the  qixant  itati  ve 
part. 

Correlation  Findings 
Inter  correlations  between  A.  C.  E.  speed  and  power  scores. 

! 
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The  question  of  whether  or  not  the  instruments  used  in  this 
study  v/ere  measuring  different  things  has  important  bearing 
upon  the  conclusions  to  be  drawn.    The  degree  of  similarity 
or  dissimilarity  between  the  function  of  the  instruments  is 
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evidenced  by  tneir  intercorrelati on. 

In  this  study  the  degree  of  relationship  between  the  y 
speed  scores  and  the  Q  power  scores  was  found  in  a  correlation 
of  .708.    This  result  does  not  make  it  possible  to  say  that 
these  two  instruments  are  measxiring  the  sanie  elements  of  scho- 
lastic aptitude  to  a  marked  degree. 

The  correlations  of  L  speed  scores  with  L  power  scores 
and  total  speed  scores  v;ith  total  pov^er  scores  v/ere  reported 
as  .827  and  .786,  respectively.    Both  these  results  show  fairly 
marked  relationships  between  the  respective  instruments.  In 
other  words  the  instruments  are  measuring  the  same  thing  such 
that  one  score  could  be  used  to  predict  the  other  va  th  a  con- 
siderable degree  of  efficiency. 

Consideration  of  these  intercorrelation  results  and  the 
failure  to  find  significant  differences  between  the  speed  and 
power  scores  for  the  Q  part  of  the  A.  C.  ii.  and  grade  averages 
poses  a  question,     Why  is  it  that  two  instruments  supposedly 
measuring  different  things  to  a  considerable  degree  when  cor- 
related v;ith  the  same  criterion,  i,  e,  grades,  fail  to  reveal 
significantly  different  results?    It  may  be  that  the  degree  of 
measurement  of  different  factors  by  these  instruments  is  not 
high  enough  to  produce  a  significant  difference.    Perhaps  the 

statistical  techniques  used  do  not  permit  sufficient  refinement  j| 


of  measuring  when  dealing  v;ith  so  homogeneous  a  group;  perh^s 
the  sample  v^as  not  large  enough  to  get  conclusive  results.  It 
is  interesting  to  note  in  this  connection  that,  if  the  group 
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had  included  more  than  1500  cases  the  difference  betvi/een  the  Q 
speed  and  power  scores  with  grades  correlation  obtained  in  this 
study  would  have  been  significant  at  the  1  per  cent  level. 

Predictability  of  the  A.  C»        as  a  speed  test.    The  cor- 
relation coefficients  of  the  Q,  L  and  total  speed  scores  vwlth 
grade  averages  were  respectively  .249,   .172,  and  .224.    All  but 
the  second  "r"  were  considered  significant  at  the  1  per  cent 
level. 

The  results  with  respect  to  the  L  part  of  the  A.  C.  E. 
lead  to  the  conclusion  that  this  part  is  of  no  practical  value 
for  prognostic  purposes  v/ith  the  group  used  in  this  study. 
Limitations  as  to  the  possibility  of  a  biased  sample  and  the 
degree  of  reliability  of  the  marks  must  be  considered. 

The  results  of  the  Q  and  total  scores  vd  th  grades  correla- 
tions, even  though  significant,  imply  that  neither  the  Q  nor 
total  speed  measures  are  v/orth  using  for  predicting  grades  of 
the  members  of  the  group  used  in  this  study.     The  limitations  ■ 
cited  in  the  paragraph  above  must  again  be  considered  in  accounljh 
ing  for  these  results. 

Predictability  of  the  A.  C.  E.  as  a  power  test.    The  rela- 
tionship of  the  Q,  L  and  total  pov/er  scores  with  grades  v;as 
found  in  correlation  coefficients  of  .315,   .121,  and  .261. 
Again  the  scores  on  the  L  part  of  the  test  failed  to  yield  a 
significant  relationship  when  correlated  v/ith  grade  averages. 
The  other  two  scores  showed  significant  though  very  low  degrees 
of  relationship  with  grades. 
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i^one  of  the  correlations  are  sufficiently  high  enough  to 
have  any  prognostic  value  for  practical  purposes • 

Implications  from  the  correlation  results.     Several  impli- 
oations  that  may  be  obtained  from  the  correlation  data  have 
not  been  discussed  heretofore. 

One  is  concerned  with  the  problem  of  accounting  for  the 
low  correlations  betv«/een  the  various  measures  and  grade  averages. 
The  possible  effect  of  group  homogeneity  in  lowering  the  "r's" 
has  been  mentioned.    But  there  are  probably  other  factors  that 
helped  produce  such  results,    uany  authors  speak  of  the  possibl< 
effects  of  personality  factors,  perseverance,  interest  charac- 
teristics, physical  well-being,  study  habits  and  other  things 
which  are  not  measured.    Any  or  all  of  these  factors  may  well  j 
have  been  operating  in  such  ways  as  to  produce  unreliable  grade^ 
or  test  scores.     It  v;ould  seen  unlikely,  however,  that  the  ef-  | 
feet  of  the  element  of  perseverance  in  producing  unreliable  test 
results  can  be  given  as  much  v/eight  in  this  study  as  in  many 
others.    The  fact  that  the  students  used  an  average  additional 
time  of  thirty-five  minutes  under  the  work-limit  test  procedure 
and  that  the  test  scores-grades  correlations  were  insignificant- 
ly different  for  the  speed  and  pov;er  procedures  would  seem  to 
indicate  this,    l^evertheless  the  perseverance  factor  may  still 
be  operating  to  a  very  effective  degree  in  producing  grades 
which  are  unreliable  in  relation  to  those  anticipated  solely  on 
the  basis  of  intelligence  test  scores.    Another  factor  that 
needs  mentioning  in  connection  with  the  lov/  '^r"  results  is  that 
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the  reliability  of  the  marking  system  may  not  have  been  high 
because  of  a  lack  of  objective  measurement  and ,  as  stated  be- 
fore, the  unusiJal  nature  of  the  institution. 

Previously  it  was  stated  that  this  study  v/as  suggested  in 
part  by  the  findings  that  a  considerable  number  of  students 
who  scored  very  low  on  the  A.  0.  ]£•  were  very  superior  in 
achievement  and  that  certain  of  these  students  scored  very  high 
on  a  work-limit  test,  the  Ohio  State  Psychological  jixaminat ion. 
It  was  felt  that  the  speed  factor  in  the  A.  G.  3,  might  be  pen- 
alizing these  lov/-scor e-high-achievement  individuals  and  helps 
to  account  for  the  very  low  correlations  between  A#  G.  j^i.  scores 
and  grades  found  in  previous  studies  at  this  institution.  The 
findings  of  this  study  do  not  seem  to  support  this  possibility 
since  significant  differences  between  the  speed  and  power  scores 
when  correlated  v«dth  grade  averages  were  not  found  while  low 
"r*s"  were  again  found*    It  is  probable  that  factors  other  than 
speed  account  for  the  low  correlations  obtained  in  this  and  the 
previous  studies  mentioned. 

Comparisons  with  findings  in  the  literature.    The  review 
of  the  literature  related  to  this  study  revealed  no  correlation! 
coefficients  for  first  semester  grades  and  A.  G.  E.  scores 
lower  than  those  found  in  this  study.    One  study  indicated  that 
very  few  correlations  between  general  intelligence  measures  and 
grade  scores  fall  belov/  .30.     ^Vith  one  exception,  all  the  ^.  C. 
E.  scores-grade  averages  correlations  in  this  study  fall  below 
•30.    This  means  that  this  institution  is  not  up  to  the  stand- 
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ards  reported.    Any  one  or  all  the  possible  reasons  given  pre- 
viously in  an  attempt  to  account  for  the  lov;  "r*s"  obtained  in 
this  study  may  also  be  used  to  explain  the  discrepancy  between 
this  institution  and  others.    Por  example,  the  group  used  in 
this  study  may  be  more  homogeneous  than  those  used  in  studies 
in  other  institutions,  the  reliability  of  the  marking  system 
may  not  be  as  high  as  compared  to  those  in  the  other  schools, 
and  so  forth.     Of  course  it  may  be  that  the  comparison  of  the 
findings  in  this  study  with  those  of  other  studies  is  not  one 
which  gives  a  fair  overall  picture  of  the  relative  standing 
of  this  institution  according  to  the  criterion  used,  kany 
studies  which  yielded  lower  correlations  than  those  cited  may 
not  have  been  reported.    Consequently  no  comparison  can  be  made. 

Summary 

The  major  question  this  study  attempts  to  answer  is:  What 
is  the  relative  value  of  the  1946  Edition  of  the  American  Coun- 
cil on  Education  Psychological  Examination  for  predicting  schol- 
astic achievement  in  the  first  semester  of  the  Preshman  year 
at  the  University  of  Massachusetts  at  Port  Devens  v/hen  it  is 
used  as  a  speed  test  and  as  a  power  test?     In  view  of  the  f ind- 
ings  the  ansv;er  is  that  the  a.  C.  E.  is  of  approximately  equal 
predictive  value  when  used  as  a  power  test  or  a  speed  test  in 
this  institution,    furthermore,  the  degree  of  relationship  be- 
tween A.  C.  E.  speed  and  pov;er  scores  v;ith  scholastic  achieve- 
ment was  found  to  be  so  low  as  not  to  warrant  the  use  of  the 
A.  C.  E.  for  prognostic  purposes. 
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CHAP TEH  V 
LLuI  TAT  IONS  OF  THIS  STUDY 
UiJj  TH£  HEED  FOR  FURTHEH  HESEAHCH 


Several  inadequacies  v/hich  bear  upon  the  interpretation 
of  the  findings  are  of  course  inherent  in  this  study.  Like- 
wise, as  v/ith  most  studies,  many  questions  are  provoked  which 
can  be  answered  only  by  further  research. 


Limitations  of  This  Study 

The  follov;ing  limitations  are  to  be  noted: 

1.    Consideration  must  be  given  to  the  fact  that  the 
group  used  in  this  study  is  atypical  v/ith  respect 
to  the  fact  that  it  is  composed  entirely  of  veterans 
of  World  War  II  who  entered  this  college  during  the 
immediate  post  war  period. 

E.     The  group  used  in  this  study  is  homogeneous  in  nature. 

3.  The  size  of  the  population  sample  on  v/hich  this  study 
is  based  is  relatively  small  for  a  correlation  study. 

4.  The  facts  that  this  school  had  been  in  operation  only 
one  year  and  that  the  faculty  is  heterogeneous  with 
respect  to  the  levels  and  amount  of  previous  teaching 
experience  must  be  considered  in  relation  to  the  re- 
liability of  the  grades  given  the  students  used  in 
this  study. 

6.  Meaningful  comparisons  between  the  A.  0.  E.  power 
scores-grade  averages  correlations  in  this  study 
and  like  correlations  from  other  studies  could  not 
be  made. 

6..  The  treating  of  students'  marks  in  different  subjects 
and  from  different  instructors  as  being  of  constant 
value  must  be  noted. 

7.  Variations  in  course  content,  methods  of  instruction 
end  standards  of  marking  among  institutions  make  it 
innpossible  to  assume  that  the  conclusions  drav«i  in 


dravm  in  this  study  may  be  applied  to  the  general 
college  population.    The  major  value  of  the  findings 
in  this  study  must  be  considered  to  be  their  use 
v/ithin  this  group  for  this  particular  school. 


Suggestions  for  i'urther  Research 
Belov/  are  some  suggestions  for  further  research  related 
to  this  study: 

1.    Would  the  results  of  this  study  using-  the  same  pro- 
cedures be  fouQd  again  for  the  University  population 
as  a  v/hole  and  for  liie  next  class  of  entering  fresh- 
men? 

ViHiat  relationship  v/ould  be  found  in  correlating 
A.  C.  E.  scores  of  this  group  for  the  different 
parts  of  the  test  and  grades  in  subject  matter 
areas  most  related  to  each  part? 

3.  How  do  the  standards  for  grading  vary  among  members 
of  each  department  and  among  departments?    Are  there 
any  significantly  different  relationships  among  the 
various  faculty  members  with  respect  to  the  distri- 
bution of  their  grades  to  students  and  the  level  and 
amount  of  their  previous  teaching  experience? 

4.  1/Vhat  kind  of  consideration  in  interpreting  the  data 
must  be  given  to  the  fact  that  the  population  sample 
used  in  this  study  consisted  entirely  of  veterans? 
Does  their  supposedly  greater  maturity,  seriousness 
of  purpose,  et  cetera  really  exist?     To  ^^at  extent 
does  this  affect  their  academic  success  in  college? 

6.    vVhat  is  the  influence  of  personality  on  academic 
success  in  college? 

6,    Are  there  any  significant  differences  betv/een  the 
follovdng  correlations: 

a.    Q  speed  scores  with  grades  and  L  speed  scores 
v;ith  grades? 

b«    Q  power  scores  v/ith  grades  and  L  power  scores 
with  grades? 

c.    Total  speed  scores  with  grades  and  L  speed 
scores  v/ith  grades? 


d.    Total  power  scoores  with  grades  and  L  pov/er 
scores  vdth  grades? 

7,     ;\rhat  factors  are  most  related  to  academic  success 
in  college? 
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I.  Purpose  of  the  Examination 

The  purpose  of  the  Psychological  Examination  of  the  American  Council  on  Education  is  to  appraise 
what  has  been  called  scholastic  aptitude  or  general  intelligence,  with  special  reference  to  the  requirements  of 
most  college  curricula,  A  large  number  of  different  tests  have  been  used  for  this  purpose.  It  has  been  found 
that,  in  general,  linguistic  tests  give  higher  correlations  with  scholarship  in  the  liberal  arts  colleges  than  do 
quantitative  tests.  This  higher  correlation  is  probably,  in  part,  due  to  the  fact  that  most  of  the  freshman 
courses  in  the  liberal  arts  colleges  depend  more  upon  linguistic  abilities  than  upon  the  abilities  involved  in 
quantitative  thinldng.   For  the  scientific  and  technical  curricula  the  quantitative  tests  may  be  more  significant. 

These  considerations  indicate  the  desirability  of  isolating  the  several  mental  abilities  and  of  appraising 
them  separately.  A  complete  program  of  this  kind  would  be  the  ideal  basis  for  educational  and  vocational 
counseling,  and  it  is  the  objective  toward  which  psychological  research  should  be  directed.  A  program  of 
tests  for  seven  primars'  mental  abilities  was  made  available  by  the  American  Council  on  Education  for  the 
first  time  in  1938  in  the  form  of  an  experimental  edition.  This  program  required  about  four  hours  of  student 
time,  and  it  was  necessarily  more  expensive  than  the  one-hour  test  in  current  use.  In  the  1938  edition  of  the 
general  Psychological  Examination  we  introduced  a  practical  compromise  whereby  two  subscores  were  obtained 
from  the  one-hour  examination,  namely,  a  subscore  for  three  linguistic  tests,  and  another  subscore  for  three 
quantitative  tests.  These  two  subscores  do  not  represent  primary  mental  abilities,  but  they  represent  two 
groups  of  abilities  significant  for  college  curricula  that  are  dominantly  linguistic  or  technical. 

In  1941  the  American  Council  on  Education  published  the  Chicago  Tests  of  Primary  Mental  Abilities. 
These  tests  yield  a  profile  of  a  pupil  in  terms  of  six  primary  mental  abilities.  These  tests  are  intended  primarily 
for  counseling  at  the  eighth  grade  and  high  school  levels  and  are  accompanied  by  nonns  for  ages  11  to  18. 
It  is  planned  to  make  a  similar  series  of  tests  available  for  use  with  college  students. 

Since  the  introduction  of  the  electric  scoring  machine  a  few  years  ago.  many  psychological  and  educa- 
tional tests  have  been  adapted  to  machine  scoring.  In  response  to  demand  from  the  larger  institutions  where 
the  scoring  machines  have  been  installed,  the  Psychological  Examination  was  adapted  to  machine  scoring  in 
an  alternative  fonn.  Two  forms  were  made  available  for  several  years,  one  for  hand  scoring  and  one  for 
machine  scoring. 

There  is  one  form  of  the  current  edition.  All  students  take  the  test  in  exactly  the  same  way,  marking 
their  answers  on  separate  answer  sheets.  The  answer  sheet  is  scored  by  hand  or  by  means  of  the  scoring 
machine.   vSeveral  advantages  result  from  this  arrangement  of  the  examination. 

One  of  the  problems  with  recent  editions  of  the  Psychological  Examination  has  been  the  comparability 
of  norms  for  the  two  fomis.  The  machine-scored  form  was  used  mostly  by  the  larger  institutions  where  scoring 
machines  are  more  common.  The  hand-scored  form  was  used  by  most  of  the  smaller  schools  and  by  some  of  the 
larger  ones.  In  tabulating  norms  for  the  two  forms  we  were  not  able  to  insure  that  the  two  populations  were 
comparable,  and  the  results  could  not  be  combined  into  the  same  set  of  norms.  Consequently,  the  users  of 
either  form  were  limited  to  the  norms  based  on  the  schools  that  used  the  same  form.  By  introducing  the 
separate  answer  sheet  for  the  hand-spored  form  as  well  as  for  the  machine-scored  form,  the  task  for  the  subjects 
is  identical.  The  nonns  can.  therefore,  be  assembled  in  one  set  of  tables,  irrespective  of  the  way  in  which  the 
test  papers  are  scored. 

This  procedure  reduces  to  a  minimum  the  amount  of  labor  in  scoring,  which  becomes  quite  simple 
when  only  one  answer  sheet  has  to  be  scored. 

The  machine-scored  test  had  the  advantage  that  the  test  booklets  could  be  used  several  times.  By 
providing  the  hand-scored  form  with  a  separate  answer  sheet,  this  advantage  is  also  extended  to  the  users  of 
the  hand-scored  test.  The  same  set  of  test  booklets  can  be  used  for  severa'.  groups  of  students,  provided 
that  the  students  do  not  make  marks  in  the  test  booldets. 

The  examination  consists  of  the  six  tests  that  have  been  used  for  several  years.  The  order  of  the  tests 
has  been  arranged  to  alternate  linguistic  and  quantitative  tests  because  of  the  fatigue  element.    All  of  the 
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tests  have  been  included  in  several  test  experiments  with  factorial  analyses  to  determine  the  primary  mental 
abilities.   These  studies  have  justified  the  grouping  of  the  six  tests  in  two  general  classes,  as  follows: 

Quantitative  Tests :  (the  Q-score) 
Arithmetical  Reasoning 
Number  Series 
Figure  Analogies 

Linguistic  Tests:  (the  L-score) 
Same-Opposite 
Completion 
Verbal  Analogies 

It  is  not  recommended  that  the  six  separate  test  scores  be  used  for  any  counseling,  but  there  seems 
to  be  justification  for  using  the  two  principal  subscores  as  well  as  the  total  or  gross  score  in  this  manner. 

The  test  forms  should  be  found  useful  in  handling  those  problems  in  which  it  is  advisable  to  distinguish 
a  student's  mental  abilities  from  his  high-school  preparation  and  his  industry.  Faculty  action  in  the  case  of  a 
student  who  is  failing  can  be  intelligently  guided  if  one  has  some  means  of  knowing  to  what  extent  the  sliulent 
has  applied  himself  to  his  college  work,  to  what  extent  his  high-school  training  meets  the  recjuirements  of 
his  college  course,  and  what  his  mental  abilities  are.  Very  different  faculty  action  can  l)e  taken,  (lc'i)en(ling 
on  which  of  these  three  factors  may  be  held  primarily  responsible  for  a  student's  failure.  It  is  to  be  hoped 
that  these  psychological  test  forms  may  lead  to  the  early  discovery  of  bright  students.  In  those  colleges  where 
sectioning  of  classes  in  accordance  with  ability  or  preparation  is  customary,  these  test  forms  may  ser\-e  as 
part  of  the  evidence  upon  which  the  sectioning  is  based. 

Perhaps  a  word  should  be  said  about  different  interpretations  of  test  scores.  Those  who  have  used 
psychological  tests  and  who  have  become  convinced  of  their  merits  sometimes  overestimate  the  significance 
of  the  test  scores.  While  the  scores  do  show  roughly  the  mental  alertness  of  the  student,  they  should  not  be 
thought  of  as  measuring  mentality  with  high  accuracy.  The  scores  are  roughly  indicative  of  the  level  of  mental 
alertness  of  the  student,  but  they  should  not  be  taken  so  seriously  as  to  exclude  other  evidences  of  intelligence 
and  talent  in  individual  cases.  On  the  other  hand,  it  is  undeniably  true  that  the  psychological  test  scores 
tell  us  much  more  about  the  mental  alertness  of  students  than  could  be  ascertained  in  a  personal  interview. 
In  those  situations  where  the  scholarship  standards  of  the  high  schools  vary  considerably,  one  is  safer  in 
judging  the  abilities  of  freshmen  by  psychological  tests  than  by  high-school  records.  Generally,  the  best 
usefulness  of  the  tests  is  in  combination  with  other  evidences  of  ability  such  as  grades  in  high  school  and  in 
content  examinations  that  are  given  uniformly  to  all  students. 


II.  How  To  Give  the  Examination 

The  conditions  that  should  l)e  observed  in  conducting  these  tests  are  similar  to  those  which  should  be 
observed  in  gi\^ing  any  objective  group  test  by  the  time-limit  method.  In  order  to  conduct  these  tests  properly, 
there  should  be  one  examiner  in  charge  of  the  whole  group  and  at  least  one  proctor  for  every  twenty  students. 
In  giving  his  instructions,  the  examiner  should  avoid  unnecessary  severity,  which  sometimes  intimidates 
students  so  that  they  do  not  do  themselves  justice.  On  the  other  hand,  the  examiner  must  command  enough 
respect  to  have  his  instructions  carried  out.  If  the  examiner  is  skillful,  he  will  get  his  students  to  take  a 
congenial  and  cooperative  attitude  toward  the  tests  and  a  competitive  attitude  toward  each  other. 

The  students  must  ha\'e  a  smooth,  hard  surface  on  which  to  place  their  separate  answer  sheets.  If 
the  chair  arms  or  desks  are  not  smooth,  some  kind  of  smooth,  hard  surface  must  be  proA'ided  for  eacli  student. 

See  that  the  students  are  seated  far  enough  apart  so  that  no  one  can  read  his  neighljor's  answers. 

3 


If  the  examination  is  to  be  scored  by  a  scoring  machine,  the  students  must  be  supplied  with  special 
pencils  which  are  obtained  from  the  International  Business  Machines  Corporation,  Endicott,  New  York. 
Instruct  the  proctors  to  distribute  the  pencils,  one  to  each  student.  State  emphatically  that  only  the  special 
pencils  are  to  be  used. 

Proceed  in  the  following  manner : 

1 .  Announce  that  no  scratch  paper  is  necessary  for  any  of  these  tests,  since  the  answer  sheet  contains  a 
special  section  which  may  be  used  for  scribbling. 

2.  After  these  preHminar>'  announcements  have  been  made,  and  when  it  has  been  ascertained  that 
every  student  is  seated  in  an  appropriate  place  and  supplied  with  a  pencil,  instruct  the  proctors  to  distribute 
the  test  pamphlets  and  the  answer  sheets,  one  of  each  to  each  student.  The  test  pamphlets  should  be  dis- 
tributed with  the  title  page  up  and  the  answer  sheets  with  Page  A  up. 

3.  While  the  proctors  are  distributing  the  pamphlets  and  answer  sheets,  announce  that  the  pamphlets 
should  not  be  opened  until  further  instructions  are  given. 

4.  When  each  student  has  been  supplied  with  an  answer  sheet,  ask  the  students  to  print  their  names 
and  the  name  of  the  college  in  the  designated  spaces  on  Page  A  of  the  answer  sheet.  If  any  other  information 
is  desired,  such  as  age,  department  or  school,  method  of  admission,  nationality  of  parents,  preparatory  school, 
and  so  on,  instruct  the  students  to  write  it  in  the  left-hand  margin  on  Page  B  of  the  answer  sheet.  This 
additional  information  will  var\^  among  the  different  colleges.  The  space  is,  therefore,  left  blank  so  that  the 
examiner  may  instruct  his  students  how  to  report  the  additional  information. 

5.  When  the  desired  information  has  been  filled  in  on  the  answer  sheets,  ask  the  students  to  open  the 
test  pamphlets  to  Page  2  and  fold  the  booklets  back.  These  "General  Instructions"  are  to  be  read  aloud  by 
the  examiner,  who  should  insert  any  explanatory  comments  or  blackboard  diagrams  which  will  help  to  clarify 
the  directions.  After  reading  the  "General  Instructions."  announce  that  the  students  are  not  to  ask  any 
questions  or  to  try  to  communicate  with  the  examiner  or  the  proctors  or  other  students  during  the  examination. 

6.  The  practice  problems  are  accompanied  by  printed  instructions.  These  instructions  are  to  be  read 
aloud  by  the  examiner.  The  students  should  work  each  practice  problem  before  the  examiner  proceeds  to  the 
next  instruction.  The  printed  directions  at  the  beginning  of  each  test  proper  are  to  be  read  silently  by  the 
students  after  the  examiner  says  "Go,"  and  tPie  time  for  reading  tlieni  is  to  be  included  in  the  time  limit  for  the 
test.  The  examiner  should  start  timing  a  test  immediately  after  he  says  "Go."  This  instruction  must  be  followed 
exactly  in  order  to  make  scores  from  different  colleges  comparable. 

7.  The  time  limits  suggested  for  the  practice  problems  are  approximate.  The  examiner  should  make 
sure  that  students  understand  the  task.  Test  scores  will  not  be  reliable  if  the  students  are  rushed  through 
the  practice  problems.  The  examiner  should  notice  when  all  students  have  completed  the  practice  problems. 
The  time  required  may  be  a  little  more  or  a  little  less  than  the  amounts  given  in  the  manual.  Announce  that 
each  test  proper  has  a  specified  time  limit.  Announce  that  in  each  case  there  will  be  a  starting  signal  at  which 
ever\-one  begins  to  work  and  a  stop  signal  at  which  everyone  stops  promptly  and  waits  for  further  instructions. 

8.  Announce  with  special  emphasis  and  with  one  or  more  repetitions:  (1)  that  under  no  circumstances 
may  any  student  begin  a  set  of  practice  problems  or  a  test  until  the  starting  signal  for  that  particidar  set  of  practice 
problems  or  test  has  been  given;  (2)  that  no  student  may  turn  back  to  a  test  after  the  time  limit  for  it  has  expired; 
and  (3)  that  each  test  must  be  worked  on  during,  and  only  during,  the  specified  time  for  it  as  announced  by  the 
examiner. 

9.  Say  to  the  students:  "You  must  not  begin  to  work  on  the  tests  until  I  give  the  signal.  Do  not  turn 
any  pages  yet." 

The  following  starting  signal  can  be  used  to  advantage :  '  The  first  test  is  called  Arithmetic — Arithmetic 
Test.  There  are  some  practice  problems  on  Page  3.  I  shall  read  the  directions  with  you.  Turn  to  Page  3 
of  the  test  booklet.   Page  A  of  the  answer  sheet  should  be  up." 

10.  The  proctors  should  be  alert  to  note  that  every  student  in  their  sections  turns  to  Page  3  and  begins 
to  work  on  the  first  set  of  practice  problems.    They  should  see  that  each  student  finds  on  the  answer  sheet 
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the  section  labeled  "ARITHMETIC,  Practice  Problems,  Page  3."  It  is  the  duty  of  the  proctors  during  each 
time  interval  to  see  that  each  student  is  working  on  the  proper  part  of  the  examination  and  on  the  corresponding 
section  of  the  answer  sheet.  The  answer  sheet  should  be  placed  under  the  test  booklet  so  that  the  answer 
spaces  being  marked  are  as  near  as  possible  to  the  questions  being  answered.  No  student  should  be  allowed 
to  return  to  one  of  the  tests  for  which  the  time  has  expired  even  if  he  finishes  the  current  test  ahead  of  time. 
No  student  should  be  allowed  to  turn  the  pages  of  his  pamphlet  to  tests  ahead  of  the  current  U'st.  Each  test 
must  be  worked  on  during,  and  only  during,  the  specified  time  for  it  as  announced  Ijy  tlie  examiner. 

11.  Allow  about  4  minutes  for  the  practice  problems  for  the  Arithmetic  Test.  When  all  the  students 
have  finished  the  practice  problems,  say:  "You  will  have  10  minutes  for  the  test  proper,  the  Arithmetic  Test, 
on  the  next  page.   Turn  to  Page  4  and  fold  your  book  back.   Go  ahead." 

The  proctors  are  to  see  that  these  instructions  are  carried  out. 

12.  After  exactly  10  minutes,  the  examiner  says:  "STOP.  Everybody  stop.  Even  if  you  have  not 
finished  the  Arithmetic  Test,  you  must  stop.  The  next  test  is  the  Completion  Test.  Turn  to  the  practice 
problems  on  Page  5.   Turn  the  answer  sheet  over  to  Page  B.    I  shall  read  the  directions  with  you." 

13.  Allow  about  3  minutes  for  the  practice  problems  for  the  Completion  Test.  When  all  the  students 
have  finished  the  practice  problems,  say:  "You  will  have  5  minutes  for  the  test  proper,  the  Completion  Test, 
on  the  next  page.   Turn  to  Page  6  and  fold  your  book  back.   Go  ahead." 

14.  After  exactly  5  minutes,  the  examiner  says:  "STOP.  Everybody  stop.  Even  if  you  have  not 
finished  the  Completion  Test,  you  must  stop.  The  next  test  is  the  Figure  Analogies  Test.  Turn  to  the  practice 
problems  on  Page  7.   Turn  the  answer  sheet  to  Page  A.    I  shall  read  the  directions  with  you." 

15.  Allow  about  5  minutes  for  the  practice  problems  on  the  Figure  Analogies  Test.  When  all  the 
students  have  finished  the  practice  problems,  say:  "You  will  have  5  minutes  for  the  test  proper,  the  Figure 
Analogies  Test,  on  the  next  page.   Turn  to  Page  8  and  fold  your  book  back.   Go  ahead." 

16.  After  exactly  5  minutes,  the  examiner  says:  "STOP.  Everybody  stop.  Even  if  you  have  not 
finished  the  Figure  Analogies  Test,  you  must  stop.  The  next  test  is  the  Same-Opposite  Test.  Turn  to  the 
practice  problems  on  Page  9.   Turn  the  answer  sheet  to  Page  B.    I  shall  read  the  directions  with  you." 

17.  Allow  about  2  minutes  for  the  practice  problems  on  the  Same-Opposite  Test.  When  all  the  students 
have  finished  the  practice  problems,  say:  "You  will  have  5  minutes  for  the  test  proper,  the  Same-Opposite 
Test,  on  the  next  page.   Turn  to  Page  10  and  fold  your  book  back.   Go  ahead." 

18.  After  exactly  5  minutes,  say :  "STOP.  Everybody  stop.  Even  if  you  have  not  finished  the  Same- 
Opposite  Test,  you  must  stop.  The  next  test  is  the  Number  Series  Test.  Turn  to  the  practice  problems  on 
Page  11.   Turn  the  answer  sheet  to  Page  A.   I  shall  read  the  directions  with  you." 

19.  Allow  about  3  minutes  for  the  practice  problems  on  the  Number  Series  Test.  When  all  the  students 
have  finished  the  practice  problems,  say:  "You  will  have  8  minutes  for  the  test  proper,  the  Number  Series 
Test,  on  the  next  page.   Turn  to  Page  12  and  fold  your  book  back.   Go  ahead." 

20.  After  exactly  S  minutes,  say :  "STOP.  Everybody  stop.  Even  if  you  have  not  finished  the  Number 
Series  Test,  you  must  stop.  The  next  test  is  the  Verbal  Analogies  Test.  Turn  to  the  practice  problems  on 
Page  13.    Turn  the  answer  sheet  to  Page  B.    I  shall  read  the  directions  with  you." 

21.  Allow  about  3  minutes  for  the  practice  problems  on  the  Verbal  Analogies  Test.  When  all  the 
students  have  finished  the  practice  problems,  say:  "You  will  have  5  minutes  for  the  test  proper,  the  \'erbal 
Analogies  Test,  on  the  next  page.   Turn  to  Page  14  and  fold  your  book  back.   Go  ahead." 

22.  After  exactly  5  minutes,  say :  "STOP.  Everybody  stop.  Even  if  you  have  not  finished  the  Verbal 
Analogies  Test,  you  must  stop.   Give  your  test  pamphlets,  answer  sheets,  and  pencils  to  the  proctors." 


III.  How  To  Score  the  Examination 


In  the  upper  left-hand  corner  of  the  answer  sheet  is  provided  a  table  for  recording  the  performance  of 
the  student. 

The  0-score  is  the  number  of  right  answers  on  Page  A  of  the  examination.  The  L-score  is  the  number 
of  right  answers  on  Page  B  of  the  examination.  The  total  score  is  the  sum  of  the  Q-score  and  the  L-score. 
The  scorer  should  record  the  L-score  on  Page  B  when  he  scores  Page  B  of  the  answer  sheet.  The  L-score  is 
later  transferred  to  Page  A  of  the  answer  sheet  and  combined  with  the  0-score  to  obtain  the  total  score. 

The  right  answers  to  the  six  tests  are  as  follows: 

ARITHMETIC:  9.  5.  800,  6>^,  15,  48,  $36,  560,  33,  $32,  60,  2%,  6,  $1.20,  12,  8,  $36.  2  27.  50.  5  6. 

COMPLETION:  S  (suburbs),  M  (mayor),  R  (retreat),  B  (bandage),  V  (veterinarian),  C  (crew),  I 
(ivory),  H  (holster),  C  (cavalry),  I  (icicle),  C  (cr3'-stal).  M  (meteorite),  S  (seance),  F  (fawn),  B  (bribe),  S 
(suffrage),  A  (alliteration),  F  (forgery),  S  (silhouette),  T  (tart),  F  (fence),  P  (pedestal),  G  (gill),  E  (equilibrium), 
H  (hamper),  T  (tender),  Z  (zenith),  A  (acoustics),  H  (hod),  G  (gobbler). 

FIGURE  ANALOGIES:  (The  numbers  refer  to  the  positions  1,  2,  3,  4,  and  5  of  the  five  answers  in 
each  row)  3,  5.  3,  4,  3,  2,  5,  1,  2,  3,  3,  3,  2,  4,  5,  4,  4,  5,  4,  3,  5,  4,  2,  4,  3,  5,  1,  3,  5.  3. 

SAME-OPPOSITE:  unrestricted,  loose,  defiant,  wicked,  detrimental,  unacceptable,  broken,  late, 
methodical,  boorish,  ecstatic,  inflexible,  minimal,  vociferous,  sorrowful,  crafty,  mangled,  transparent,  limp, 
mutual,  irresolute,  whimsical,  effusive,  humble,  pretentious,  forlorn,  slovenly,  scant,  muddy,  daily,  penetrable, 
obese,  unusual,  mad,  inelastic,  garish,  solitan,',  melodious,  upright,  unfavorable,  jocular,  negligent,  diligent, 
false,  authentic,  gruff,  hypercritical,  shining,  casual,  comical. 

NUMBER  SERIES:  7.  35,  25,  24,  30,  16,  17.  12,  30,  18,  6,  32,  8,  22,  42,  6,  13,  12,  8,  16.  46,  17.  14, 
20,  14,  17,  7,  48,  63,  2. 

VERBAL  ANALOGIES:  nation,  cage,  forget,  death,  signals,  christen,  pound,  decay,  idiot,  storm, 
carriage,  whale,  decide,  skate,  guard,  lens,  recruit,  bolt,  mechanic,  road,  stop  light,  anchor,  peak,  certain,  warning 
cat,  mutiny,  engine,  tone,  band,  debutante,  shoe,  eternal,  plead,  garment,  planet,  bumper,  cube,  rail,  torrent. 


A  Manual  Scoring  Board 

For  several  years  we  have  been  using  a  scoring  board  for  the  hand  scoring  of  psychological  tests.  The 
device  is  very  simple  and  it  saves  not  only  considerable  time  in  scoring  but  it  has  been  found  also  to  reduce 
clerical  errors.  It  is  not  patented,  and  it  will  be  described  here  as  a  suggestion  for  those  who  want  to  make  it. 
The  board  is  manufactured  and  distributed  by  C.  H.  Stoelting  and  Company  in  Chicago. 

The  scoring  board  is  shown  in  the  figure.  It  consists  of  a  board  of  ph^'ood  or  masonite  which  is  cut 
somewhat  larger  than  a  double  letter- size  sheet.  Two  clips  A  are  mounted  at  the  upper  edge  of  the  board  as 
shown.  These  are  similar  to  the  clips  on  the  familiar  clip  boards.  Along  the  same  upper  edge  is  fastened  a 
metal  strip  B  and  along  the  left  edge  is  another  metal  strip  C.  These  strips  ser\-e  as  guides  for  the  exact 
location  of  the  test  paper  to  be  scored.  The  stencil  D  is  fastened  in  position  under  the  clip  A  as  shown.  When 
the  stencil  has  been  mounted  in  the  correct  position  under  the  clip,  it  remains  there  for  the  scoring  without 
further  handling  or  adjustment. 

The  figure  shows  the  answer  sheet  E  which  slides  under  the  stencil  until  it  meets  the  two  guide  strips 
B  and  C.    The  answer  sheet  is  then  in  correct  position  under  the  stencil  holes  so  that  it  can  be  scored.  When 
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it  has  been  scored,  the  paper  is  removed  and  the  next  paper  is  inserted  under  the  fixed  stencil.  In  this  manner 
the  scoring  involves  the  handling  of  only  one  paper,  the  answer  sheet,  instead  of  both  the  stencil  and  answer 
sheet  as  in  ordinary  hand  scoring.  The  two  holes  shown  at  F  facilitate  lifting  the  answer  sheet  from  its  scoring 
position.  The  two  clips  are  provided  so  that  both  sides  of  the  sheet  can  be  scored  in  rapid  succession.  That 
involves  the  insertion  of  two  stencils,  one  under  each  clip. 

The  usual  hand-scoring  procedure  requires  that  the  clerk  match  the  stencil  carefully  over  the  answer 
sheet  for  each  paper  that  is  to  be  scored.  The  present  scoring  board  facilitates  this  matching  because  when  the 
paper  is  moved  under  the  stencil  to  the  two  guide  strips,  it  is  automatically  in  the  correct  position  for  scoring. 
The  exact  position  of  the  stencil  can  be  easily  adjusted  under  the  clip. 

If  the  stencil  and  the  answer  sheet  are  of  the  same  size,  it  is  necessary  to  paste  a  strip  of  cardboard  to 
the  upper  edge  of  the  stencil  in  order  to  make  the  stencil  slightly  longer  for  insertion  under  the  clip. 

When  a  large  amount  of  hand  scoring  is  to  be  done,  the  scoring  board  saves  about  half  the  time  ordinarily 
required  for  this  work. 

IV.  Norms  of  Performance 


Norms  for  the  interpretation  of  scores  on  the  current  edition  of  the  examination  are  prepared  by  the 
authors  on  the  basis  of  the  reports  sent  in  by  the  colleges  using  the  test.  The  norms  include  tables  of  percentiles 
for  the  three  sets  of  scores:  (1)  the  Q-scores,  which  represent  ability  to  think  in  quantitative  terms;  (2)  the 
L-scores,  which  depend  upon  linguistic  ability;  and  (3)  the  total  scores,  which  involve  both  abilities. 
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A  set  of  record  sheets,  on  which  the  scores  of  the  students  may  be  entered,  is  suppHed  with  the  tests. 
The  record  sheets  have  spaces  for  the  0-scores,  the  L-scores,  and  the  total  scores. 

Record  sheets  for  the  current  edition  of  the  examination  should  be  sent  to  L.  L.  Thurstone,  the  University 
of  Chicago,  Chicago  37 ,  Illinois.  The  record  sheets  will,  however,  be  returned  to  the  colleges  as  soon  as  the  data 
from  them  have  been  tabulated. 

If  any  colleges  send  in  frequency  distributions  of  scores,  we  can  use  them  if  the  class  interval  is  1  for 
the  0-scores  and  L-scores,  and  5  for  the  total  scores. 

A  preliminary^  report  of  norms  will  be  issued  in  the  autumn,  as  soon  as  a  sufficient  number  of  reports 
have  been  received.  Comprehensive  norms  for  the  examination  will  be  published  in  Series  V  of  the  American 
Council  on  Education  Studies  in  the  spring.   All  records  received  by  the  first  of  March  are  included  in  this  report. 

A  special  report  will  be  sent  to  each  college  submitting  its  records  showing  its  mean  gross  score,  its 
rank  with  respect  to  the  other  colleges  reporting,  and  the  percentile  rank  of  its  mean. 

The  scores  of  each  college  are  kept  confidential.  In  the  final  report  of  norms  each  college  is  assigned  a 
code  number.    Its  name  appears  only  in  an  alphabetical  list  of  participating  colleges. 

It  should  be  optional  with  each  college  whether  or  not  scores  are  to  be  reported  to  the  students.  There 
is  always  inquiry  from  students  about  the  announcement  of  their  test  scores.  If  it  is  decided  to  tell  students 
their  0-scores,  L-scores,  and  total  scores,  it  will  be  necessary'  to  translate  the  scores  into  percentile  ranks, 
because  the  raw  scores  are  not  directly  comparable. 

We  have  rather  frequent  inquiry  about  the  translation  of  test  scores  into  intelligence  quotients  and 
mental  ages.  Mental  ages  and  intelligence  quotients  do  not  exist  for  these  tests  in  the  range  of  college  students. 
Perhaps  a  few  words  of  explanation  should  be  given  here.  The  intelligence  quotient  is,  by  definition,  the  ratio 
of  the  mental  age  to  the  chronological  age.  The  mental  age  of  a  test  performance  is  the  chronological  age  for 
which  the  test  performance  is  the  average.  It  follows  from  this  definition  that  mental  ages  and  inteUigence 
quotients  are  indeterminate  for  the  upper  half  of  the  adult  population.  If  a  person  scores  above  the  average 
for  adults  in  a  psychological  examination,  then  there  exists  no  age  for  which  his  score  is  the  average.  College 
students  can  be  assumed  to  score  above  the  average  for  the  adult  population  of  the  country,  and,  consequently, 
they  cannot  be  assigned  any  mental  ages  or  intelligence  quotients.  This  is  not  a  debatable  question.  It  is  a 
question  of  very  simple  and  straightfon\-ard  logic. 

Intelligence  quotients  are  sometimes  assigned  to  the  upper  half  of  the  adult  population  by  changing  the 
definition  of  mental  age.  For  example,  a  mental  age  of  fifteen  or  eighteen  does  not  mean  the  average  test 
performance  of  people  of  that  age.  Such  mental  ages  are  arbitrary^  designations  of  what  the  test  author  may 
choose  to  call  superior  adult  performance. 

Test  norms  should  be  interpreted  in  terms  of  percentile  ranks  or  of  standard  scores  for  a  specified  group. 
If  norms  were  interpreted  in  this  manner  for  all  age  groups,  we  could  easily  avoid  the  ambiguities  and  absurdities 
of  mental  ages  and  intelligence  quotients  for  superior  adults.  A  table  of  percentile  ranks  for  each  age  group 
gives  much  more  information  than  the  mental  age,  even  for  young  children.  With  such  tables,  the  test 
performance  of  a  child  could  be  given  an  age  assignment,  if  such  age  existed;  the  child  could  be  given  a  percentile 
rank  in  comparison  with  any  desired  age  group ;  or,  his  performance  might  be  compared  directly  with  the  test 
performance  of  different  groups  of  subjects  that  represented  different  selective  conditions. 
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General  Instructions 


This  examination  is  different  from  the  ordinary  school  examinations  to  which  you  have  been  accustomed. 
The  plan  for  each  of  these  tests  is  as  follows.  First,  you  are  given  detailed  instructions  about  the  test,  so  that 
you  know  just  what  you  are  expected  to  do.  Then  you  have  some  practice  problems.  Then  you  go  to  the  test 
proper.  This  is  the  procedure  for  each  of  the  six  tests  in  this  examination.  The  total  examination  requires 
an  hour. 

The  six  tests  in  this  examination  represent  a  variety  of  tasks.  Three  of  them  involve  thinking  of  a 
quantitative  sort,  while  the  other  three  require  more  linguistic  ability.  If  you  find  one  test  hard,  do  not  be  dis- 
couraged.   You  may  find  the  next  test  easier.    But  you  should  do  your  best  on  all  the  tests. 

People  differ  markedly  in  the  speed  with  which  they  can  do  these  dift'erent  tests.  The  tests  are  long 
enough  to  keep  everyone  busy  for  the  whole  time,  and  you  are  not  expected  to  complete  the  tests  in  the  time 
allowed.  By  noting  how  many  questions  you  can  answer  in  a  certain  length  of  time,  we  can  determine  your 
speed  on  each  kind  of  test.  You  must  begin  to  work  on  a  test  promptly  when  the  examiner  caUs  the  starting 
time  and  stop  immediately  when  he  says:  "Stop."  Do  not  begin  a  test  until  the  examiner. gives  the  starting 
signal  for  that  particular  test.  Do  not  turn  back  to  a  test  after  the  time  for  it  has  expired.  You  are  to  work 
on  each  test  during,  and  only  during,  the  specified  time  as  announced  by  the  examiner  in  charge. 

You  are  to  record  your  answers  on  a  separate  answer  sheet  rather  than  on  the  pages  of  the  test  booklet. 
Instead  of  writing  down  your  answers  in  the  usual  manner,  you  will  record  each  answer  by  blackening  the  space 
between  a  pair  of  lines.    Do  not  make  any  marks  or  record  any  answers  on  the  pages  of  this  test  booklet. 

Your  answer  sheet  will  be  scored  accurately  if  you  observe  carefully  the  following  directions : 

1.  On  the  answer  sheet,  find  the  section  which  corresponds  to  the  practice  problems  or  test  proper  on 
which  you  are  working. 

2.  Then  find  the  row  of  answer  spaces  which  is  numbered  the  same  as  the  question  you  are  answering. 

3.  Then  find  the  pair  of  dotted  lines  which  corresponds  to  the  answer  you  choose  and  blacken  the  space. 
MISPLACED  ANSWERS  ARE  COUNTED  AS  WRONG  ANSWERS. 

4.  Indicate  each  answer  with  SOLID  BLACK  PENCIL  MARKS  drawn  vertically  between  the  two 
dotted  lines.  Solid  black  marks  are  made  by  going  over  each  mark  two  or  three  times  and  by  pressing  firmly 
on  the  pencil. 

5.  Make  your  marks  as  long  as  the  dotted  lines. 

6.  If  you  change  your  answer,  erase  your  first  mark  completely. 

7.  Make  no  unnecessarN'  marks  in  or  around  the  dotted  lines. 

8.  Keep  your  answer  sheet  on  a  hard  surface  while  marking  your  answers. 

9.  Make  no  folds  or  creases  in  the  answer  sheets. 

10.  No  scratch  paper  is  allowed  in  any  of  these  tests.  The  answer  sheet  contains  a  special  section  which 
may  be  used  for  scribbling. 

11.  Fold  the  pages  of  your  test  booklet  back  so  that  only  one  page  is  visible.  Place  the  test  booklet  to 
the  left.  Keep  the  answer  sheet  under  the  test  booklet  so  that  the  answer  spaces  being  marked  are  as  close  as 
possible  to  the  questions  being  answered. 

(Omit  the  next  paragraph  unless  the  tests  are  to  be  machine-scored.) 

The  examination  will  be  scored  by  an  electric  test-scoring  machine,  which  makes  use  of  the  fact  that  a 
solid  black  pencil  mark  will  carr\^  a  current  of  electricity  in  the  same  way  that  a  copper  wire  does.  LIGHT 
PENCIL  MARKS  MADE  WITH  A  HARD  PENCIL  WTLL  NOT  CARRY  A  CURRENT  OF  ELEC- 
TRICITY !  The  machine  will  not  give  you  a  correct  score  unless  you  indicate  your  answers  with  solid  black 
pencil  marks  made  with  the  special  pencil  which  is  provided.  Do  not  use  any  pencil  other  than  the  special  one 
provided.  The  machine  cannot  distinguish  between  intended  answers  and  stray  pencil  marks.  If  you  are 
careless  in  erasing,  or  if  you  leave  unnecessary'  marks  on  or  near  the  pairs  of  lines,  such  marks  may  be  counted 
by  the  machine  as  wrong  answers  so  that  your  score  will  be  lower  than  it  should  be. 

Wait  until  the  examiner  gives  the  starting  signal  for  the  first  set  of  practice  problems. 
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PRACTICE  PROBLEMS 

In  this  test  you  will  be  given  some  problems  in  arithmetic.  After  each  problem  there  are  five  answers, 
but  only  one  of  them  is  the  correct  answer.  You  are  to  solve  each  problem  and  blacken  the  space  on  the  answer 
sheet  which  corresponds  to  the  answer  you  think  is  correct.   The  following  problem  is  an  example. 


1.  How  many  pencils  can  you  buy  for  50  cents  at  the  rate  of  2  for  5  cents? 
(a)  10  (b)  20  (c)  25  (d)  100  (e)  125 


Find  on  the  answer  sheet  the  space  labeled  "ARITHMETIC,  Practice  Problems,  Page  3."  The  correct 
answer  to  the  problem  is  20,  which  is  answer  (b). 

In  the  row  numbered  1 ,  space  (b)  has  been  blackened. 

In  the  second  row,  blacken  the  space  which  corresponds  to  the  answer  to  the  second  practice  problem. 


2.  If  James  had  4  times  as  much  money  as  George,  he  would  have  $16.  How  much 
money  has  George  ? 

(a)  $4  (b)  $8  (c)  $12  (d)  $16  (e)  $64 


You  should  have  blackened  space  (a),  which  corresponds  to  $4,  the  correct  answer. 
Blacken  the  spaces  corresponding  to  the  answers  to  the  following  problems: 


3.  In  5  days  Harry  has  saved  a  dollar.   What  has  his  average  daily  saving  been? 

(a)  20^  (b)  22K?^       (c)  25^f  (d)  30ff  (e)  40ff 

4.  John  sold  4  magazines  at  5  cents  each.    He  kept  }4  the  money  and  with  the 
other  }4  he  bought  papers  at  2  cents  each.   How  many  did  he  buy? 

(a)  3  (b)  4  (c)  5  (d)  6  (e)  10 


When  the  signal  is  given  (not  yet),  turn  the  page  and  work  more  problems  of  the  same  kind.  Work 
rapidly  and  accurately.  Your  rating  will  be  the  total  number  of  correct  answers.  You  may  not  be  able  to 
finish  in  the  time  allowed. 

Stop  here.    Wait  for  th«  signal. 
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Completion 

PRACTICE  PROBLEMS 
Look  at  the  following  definition.    You  are  to  think  of  the  word  that  fits  the  definition. 


1.  A  contest  of  spe 

ed. 

B 

F 

M 

P 

R 

The  word  is  race.  The  letter  R  is  the  first  letter  in  the  word  race.  In  the  section  of  the  answer  sheet 
labeled  "COMPLETION,  Practice  Problems,  Page  5,"  the  space  indicated  by  R  in  the  first  row  has  been 
blackened. 

Blacken  the  space  corresponding  to  the  first  letter  of  the  word  which  fits  the  following  definition. 


2.  A  place  or  building  for  athletic  exercises. 

C  D  G  H  T 


The  word  is  gymnasium.  You  should  have  marked  the  space  indicated  by  G  because  it  is  the  first 
letter  in  the  word  gymnasium. 

Do  the  following  examples  in  the  same  way : 


3. 

The  thin  cutting  part  of  an  instrument,  as  of  a  knife  or  sword. 

A  B 

D             H  W 

4. 

The  wife  of  a  king. 

F  N 

P              Q  V 

5. 

A  small  or  portable  bed,  a 

s  of  canvas  stretched  on  a  frame. 

C  G 

N             P  T 

When  the  starting  signal  is  given  (not  yet),  turn  the  page  and  work  more  problems  of  the  same  kind. 
Work  rapidly  because  your  rating  will  be  the  total  number  of  correct  answers.  You  may  not  be  able  to  finish 
in  the  time  allowed.  • 

Stop  here.    Wait  for  the  signal. 
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Fig-ure  Analogies 

PRACTICE  PROBLEMS 

Look  at  the  figures  A,  B,  and  C  in  Sample  1  below.  Figure  A  is  a  large  circle.  Figure  B  is  a  small 
circle.  By  what  rule  is  Figure  A  changed  to  make  Figure  B ?  The  rule  is  "making  it  smaller."  Now  look  at 
Figure  C.  It  is  a  large  square.  What  will  it  be  if  you  change  it  by  the  same  rule '  It  will  be  a  small  square  of 
the  same  color  as  the  large  square.  Figure  2  is  a  small  white  square.  In  the  section  of  the  answer  sheet  labeled 
"FIGURE  ANALOGIES,  Practice  Problems,  Page  7,"  the  space  numbered  2  in  the  first  row  has  been 
blackened  to  indicate  the  correct  answer. 

A  B  C  1  2  3  4  5 


'Oo        □  ■□□oO 


In  Sample  2  below,  the  rule  is:  "Turn  Figure  A  upside  down  to  make  Figure  B."  Now  look  at  Figure 
C  and  think  how  it  would  look  when  turned  upside  down.  It  would  look  like  Figure  4.  The  space  numbered  4 
has  already  been  blackened  on  the  answer  sheet. 

A  B  C  1  2  ,^  4  ,S 


^   T     i         T         T     I     i     1  T 


In  Sample  3  below,  the  rule  has  two  parts:  "Make  Figure  B  of  the  opposite  color  and  larger  than  Figure 
A."    Apply  the  rule  to  Figure  C  and  blacken  the  space  which  corresponds  to  the  correct  answer. 

A  B  C  1  2  3  4  5 


You  should  have  blackened  the  space  numbered  1,  which  corresponds  to  the  large  white  square. 
Notice  that  the  rule  changes  from  one  example  to  another.    You  are  to  do  four  things  to  each  exercise 
on  this  page  and  the  next. 

a.  Decide  what  rule  is  used  to  change  Figure  A  to  Figure  B. 

b.  Apply  this  rule  to  Figure  C. 

c.  Select  the  resulting  figure  from  the  five  figures  at  the  right. 

d.  Blacken  the  space  on  the  answer  sheet  which  is  numbered  the  same  as  the  figure  you  have  selected 
Proceed  to  the  four  exercises  below,  marking  your  answers  on  the  answer  sheet.    Go  ahead. 


A 

B 

C 

1 

2 

3 

4  5 

-  □ 

d 

+ 

1- 

^  88 

8 

ffl 

□ 

0  B 

6  © 

© 

© 

0 

© 

© 

©  © 

^  o 

o 

□ 

□ 

o 

a 
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Same-Opposite 

PRACTICE  PROBLEMS 
The  word  at  the  left  in  the  following  line  is  "many  " 


1.  many  (1)  ill  (2)  few  (3)  down  (4)  s(jnr 


One  of  the  four  words  at  the  right  means  either  the  same  as  or  the  opposite  of  "many."  The  word  "few," 
which  is  numbered  2,  is  the  opposite  of  "many."  In  the  section  of  the  answer  sheet  labeled  "SAME- 
OPPOSITE,  Practice  Problems,  Page  9,"  space  number  2  in  the  first  row  has  been  blackened. 

The  word  at  the  left  in  the  second  example  is  "ancient."  Select  one  of  the  four  words  at  the  right  that 
means  the  same  as  or  the  opposite  of  "ancient."  In  the  second  row  on  the  answer  sheet,  blacken  the  space 
which  corresponds  to  the  answer  you  have  selected. 


2.  ancient         (1)  dry  (2)  long  (3)  happy         (4)  old 


You  should  have  blackened  the  space  numbered  4,  because  4  corresponds  to  "old,"  which  means  the 
same  as  "ancient." 

In  each  of  the  following  lines  select  the  word  that  means  the  same  as  or  the  opposite  of  the  word  at  the 
left.'    On  the  answer  sheet,  blacken  the  space  which  corresponds  to  the  answer  you  have  selected. 


3.  deep            (1)  blue 

(2)  shallow 

(3)  tense 

(4)  watery 

4.  awkward       (1)  clumsy 

(2)  loyal 

(3)  passive 

(4)  young 

5.  hot               (1)  dry 

(2)  cooked 

(3)  red 

(4)  cold 

When  the  starting  signal  is  given  (not  yet),  turn  the  page  and  work  more  problems  of  the  same  kind. 
Work  rapidly  because  your  rating  will  be  the  total  number  of  correct  answers.  You  may  not  be  able  to  finish 
in  the  time  allowed. 

Stop  here.    Wait  for  the  signal. 
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PRACTICE  PROBLEMS 

"Tlhe  inumbers  in  each  series  proceed  aoooirding  to  some  rule.  For  each  series  you  are  to  find  the  next 
mtmiber. 

In  the  first  series  below,  each  number  is  2  larger  than  the  preceding  number.  The  next  number  in  the 
iseries  would  be  14.  Of  the  five  answers  at  the  right,  answer  (e)  is,  therefore,  correct.  In  the  section  of  the 
;aittswer  sheet  ilabeled  "NUMBER  SERIES,  Practicffi  Problems,  Page  11,"  space  (e)  in  the  first  row  has  been 
Madkened. 

Series  Next  Number 

a.  2        4        6        8       10       12  10       11       12       13  14 

(a)        (b)        (c)        (d)  (e) 


Find  the  malte  in  the  series  below,  and  blacken  one  of  the  answer  spaces  in  the  second  rov;  on  the  answer 

^hffiett. 

2L         20       19       18       17       16       15  10       12       14       15  16 

(a)        (b)        (c)        (d)  (e) 

Each  number  in  this  series  is  1  less  than  the  preceding  number.  You  should  have  blackened  space  (c), 
whiclh  comesponds  to  14,  the  next  number  in  the  series. 

Fitid  the  rule  in  the  series  below,  and  blacken  the  space  on  the  answer  sheet  which  corresponds  to  the 
next  number. 

3.         10        8       11        9       12       10  9       10       11       12  13 

fa)        (b)        (c)        (d)  (e) 

The  series  above  goes  by  alternate  steps  of  subtracting  2  and  adding  3.  You  should  have  blackened 
space  (e),  which  corresponds  to  13,  the  next  number. 

In  each  series  below,  find  the  rule  and  blacken  the  space  on  the  answer  sheet  which  corresponds  to  the 
next  number.  There  is  a  difi"erent  rule  for  each  series.   Go  right  ahead.   Do  not  wait  for  any  signal. 


4. 

8 

11 

14 

17 

20 

23 

10 

13 

23 

25 

26 

(b) 

(c) 

(d) 

(e) 

5. 

27 

27 

23 

23 

19 

19 

15 

16 

17 

18 

19 

(b) 

(c) 

(d) 

(e) 

6. 

16 

17 

19 

20 

22 

23 

18 

20 

22 

24 

25 

(a) 

(b) 

(c) 

(d) 

(e) 

When  the  starting  signal  is  given  (not  yet),  turn  the  page  and  work  more  problems  of  the  same  kind. 
Work  rapidly  because  your  rating  will  be  the  total  number  of  correct  answers.  You  may  not  be  able  to  finish 
in  the  time  allowed. 

Stop  here.    Wait  for  the  sigrnal. 
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Verbal  Analogies 

PRACTICE  PROBLEMS 

Read  the  following  words : 

1.  foot-shoe         hand-        (1)  thumb     (2)  head     (3)  glove      (4)  finger 

The  first  two  words,  foot-shoe,  are  related.  The  next  word  is  hand.  It  can  be  combined  with  one  of 
the  remaining  words  in  the  row  so  as  to  make  a  similar  pair,  hand-glove.  In  the  section  of  the  answer  sheet 
labeled  "VERBAL  ANALOGIES,  Practice  Problems,  Page  13,"  space  number  3  in  the  first  row  has  been 
blackened. 


Read  the  following  words : 

2.  father-son        mother-      (1)  aunt       (2)  sister       (3)  child      (4)  daughter 

The  first  pair  is  father-son.  The  next  word  is  mother.  It  can  be  combined  with  the  word  daughter 
to  make  the  similar  pair,  mother -daughter.  In  the  second  row  on  the  answer  sheet,  blacken  space  number  4, 
which  corresponds  to  the  word  daughter. 

In  each  row  of  words,  the  first  two  words  form  a  pair.  The  third  word  can  be  combined  with  another 
word  to  form  a  similar  pair.  Select  the  word  which  completes  the  second  pair.  On  the  answer  sheet,  blacken 
the  space  which  corresponds  to  the  word  you  select. 

3.  sky-blue  grass-        (1)  green     (2)  sod         (3)  path       (4)  blue 

4.  ice-solid  water-        (1)  hard       (2)  fire  (3)  iron       (4)  liquid 

In  the  third  row  on  the  answer  sheet,  you  should  have  blackened  space  number  1,  which  corresponds 
to  green.    In  the  fourth  row,  you  should  have  blackened  space  number  4,  which  corresponds  to  liquid. 

Select  the  answers  to  the  following  problems  and  blacken  the  corresponding  spaces  on  the  answer  sheet. 
Go  right  ahead.    Do  not  wait  for  any  signal. 


5. 

ear-music 

nose- 

(1)  face 

(2)  perfume 

(3)  breath 

(4)  tone 

6. 

cloth-dye 

house- 

(1)  shade 

(2)  paint 

(3)  brush 

(4)  door 

7. 

green-grass 

yellow- 

(1)  silver 

(2)  color 

(3)  golden 

(4)  gold 

8. 

cattle-hay 

man- 

(1)  eat 

(2)  bread 

(3)  water 

(4)  life 

When  the  starting  signal  is  given  (not  yet),  turn  the  page  and  work  more  problems  of  the  same  kind. 
Work  rapidly  because  your  rating  will  be  the  total  number  of  correct  answers.  You  may  not  be  able  to  finish 
in  the  time  allowed. 

Stop  here.    Wait  for  the  signal. 
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